00010000:00010000:0.0F:1787096255.152503:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1787096255.485691:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0F:1787096255.485772:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077052544 00000100:00100000:1.0:1787096255.485788:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077052544 00000100:00080000:3.0:1787096255.485830:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096255.485854:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:1.0:1787096255.485863:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aad126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+13:27995:x1873906077052544:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1787096255.485900:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096255.485921:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41082 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.485979:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d60d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.485991:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.486001:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096255.486034:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096255.486037:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096255.486053:0:6476:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.486072:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41082 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.486083:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d60d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41082 expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.486089:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:1.0:1787096255.486092:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096255.486094:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880e00, rc 0) 00000100:00100000:1.0:1787096255.486156:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aad126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+14:27995:x1873906077052544:12345-192.168.201.52@tcp:101:rm.0 Request processed in 295us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096255.486162:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 140 00000100:00100000:3.0:1787096255.487071:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096255.487117:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077052672 00000100:00100000:1.0:1787096255.487123:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077052672 00000100:00100000:1.0:1787096255.487163:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:1.0:1787096255.487171:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aad127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+14:27995:x1873906077052672:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1787096255.487180:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096255.487188:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41089 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487216:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487224:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487230:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487238:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487243:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487248:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487305:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50d629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487318:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50d629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487323:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50d629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096255.487344:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 0 00000004:00200000:1.0:1787096255.487346:0:10275:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096255.487379:0:10275:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50d629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487387:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50d629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487393:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487397:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487402:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487406:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096255.487409:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487414:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487421:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:1.0:1787096255.487429:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096255.487432:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487436:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d61b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487445:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487450:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487454:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487458:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096255.487460:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487463:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487469:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff8c7a92c71b00) 00010000:00010000:1.0:1787096255.487471:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096255.487473:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487477:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d622 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487497:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41089 expref: 16 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487517:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50d629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41089 expref: 15 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.487522:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8c7a8b27ac00) 00010000:00010000:1.0:1787096255.487524:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096255.487526:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880c00, rc 0) 00000100:00100000:1.0:1787096255.487558:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aad127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+15:27995:x1873906077052672:12345-192.168.201.52@tcp:101:rm.0 Request processed in 388us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096255.487565:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 141 00000100:00100000:2.0F:1787096255.489077:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096255.489118:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077052928 00000100:00100000:3.0:1787096255.489123:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077052928 00000100:00100000:3.0:1787096255.489151:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:3.0:1787096255.489158:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+15:27995:x1873906077052928:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:3.0:1787096255.489185:0:8384:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787096255.489196:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880c00/0x9eebb2eb7f50d629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41089 expref: 15 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489206:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8c7a8b27ac00) 00010000:00010000:3.0:1787096255.489214:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d60d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41082 expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489220:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a8b27a300) 00010000:00010000:3.0:1787096255.489223:0:8384:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096255.489234:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489240:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489245:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489252:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489257:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489272:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489308:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489313:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489318:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489509:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489520:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489526:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489531:0:8384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489535:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489539:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489556:0:8384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787096255.489566:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.489573:0:7400:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096255.489580:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.489581:0:7400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489595:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.489596:0:7400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c9e00 already unused, calling callback (ffffffffc0bef6f0) 00010000:00010000:1.0:1787096255.489603:0:7400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489604:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c8c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096255.489609:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.489613:0:7400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489616:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.489629:0:7400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8c7ab3f9f200) 00010000:00010000:1.0:1787096255.489632:0:7400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787096255.489635:0:7400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489638:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8c7ab3f9f200) 00010000:00010000:1.0:1787096255.489640:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9e00/0x9eebb2eb7f50d645 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489642:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096255.489647:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489652:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d63e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096255.489652:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096255.489662:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096255.489664:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096255.489667:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489672:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489676:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489679:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c8000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096255.489687:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489691:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489696:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7ab3f9fd00) 00010000:00010000:3.0:1787096255.489698:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096255.489699:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489703:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d630 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096255.489710:0:8384:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e619782e reply state 00000000a1ec3b97 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489719:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096255.489726:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff8c7a92c71b00) 00010000:00010000:3.0:1787096255.489728:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096255.489731:0:8384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787096255.489776:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+15:27995:x1873906077052928:12345-192.168.201.52@tcp:36:rm.0 Request processed in 617us (699us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787096255.489783:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 142 00000100:00100000:2.0:1787096255.984522:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084442752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096255.984522:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aac3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084442624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096255.984598:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096255.984606:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084442880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096255.984642:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096255.984671:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084443008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096255.984698:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096255.984711:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084442752 00000100:00100000:2.0:1787096255.984717:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084442752 00000100:00100000:1.0:1787096255.984743:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084442880 00000100:00100000:1.0:1787096255.984749:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084442880 00000100:00100000:2.0:1787096255.984769:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084442624 00000100:00100000:2.0:1787096255.984775:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084442624 00000100:00100000:1.0:1787096255.984787:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787096255.984800:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084442752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096255.984807:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787096255.984820:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084442880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787096255.984833:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787096255.984848:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096255.984917:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084442752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096255.984924:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084442880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096255.984931:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787096255.984940:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787096255.984959:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787096255.984970:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084442624:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787096255.984983:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787096255.984988:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787096255.984994:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096255.985030:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084442880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096255.985037:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084442624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096255.985047:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787096255.985075:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096255.985104:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084442752:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787096255.985135:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7aac3b3800 x1873906084442624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096255.985155:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aac3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084442624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096255.985175:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36cee2c3-5860-4e4f-81d9-386cc3395e70:3628:1873906084443136:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.985230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096255.985269:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084443392:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.985275:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084443648:0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.985317:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096255.985335:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084443136 00000100:00100000:1.0:1787096255.985340:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084443136 00000100:00100000:2.0:1787096255.985384:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1873906084443904:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.985419:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787096255.985426:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096255.985431:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3628:x1873906084443136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.985459:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787096255.985470:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1873906084443520:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.985480:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3628:x1873906084443136:12345-0@lo:400:kworker.0 Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096255.985489:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787096255.985510:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096255.985536:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084443904 00000100:00100000:2.0:1787096255.985540:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1873906084444032:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.985543:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084443904 00000100:00100000:2.0:1787096255.985587:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096255.985589:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084443520 00000100:00100000:1.0:1787096255.985595:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084443520 00000100:00100000:1.0:1787096255.985631:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084444032 00000100:00100000:1.0:1787096255.985635:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084444032 00000100:00100000:2.0:1787096255.985638:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084443392 00000100:00100000:2.0:1787096255.985644:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084443392 00000100:00100000:1.0:1787096255.985658:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787096255.985670:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1873906084443904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.985695:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787096255.985709:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084443392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.985726:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1873906084443904:12345-0@lo:400:kworker.0 Request processed in 59us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096255.985734:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787096255.985757:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787096255.985766:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084443392:12345-0@lo:400:kworker.0 Request processed in 61us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096255.985769:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1873906084443520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.985783:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787096255.985822:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787096255.985825:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1873906084443520:12345-0@lo:400:kworker.0 Request processed in 58us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096255.985836:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787096255.985840:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1873906084444032:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787096255.985869:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787096255.985888:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096255.985902:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1873906084444032:12345-0@lo:400:kworker.0 Request processed in 68us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096255.985911:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787096255.985932:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084443008 00000100:00100000:1.0:1787096255.985938:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084443008 00000100:00100000:2.0:1787096255.985953:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1873906084443264:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.985979:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787096255.985989:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084443008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096255.985998:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787096255.986008:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096255.986029:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1873906084443776:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.986056:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084443008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096255.986068:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096255.986068:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787096255.986091:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787096255.986119:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7983885500 x1873906084443008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096255.986120:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084443264 00000100:00100000:2.0:1787096255.986126:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084443264 00000100:00100000:1.0:1787096255.986141:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084443008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096255.986160:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084443776 00000100:00100000:2.0:1787096255.986164:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084443776 00000100:00100000:1.0:1787096255.986172:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096255.986201:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a90178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1873906084444160:0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.986204:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787096255.986218:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1873906084443264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.986246:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096255.986275:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1873906084443264:12345-0@lo:400:kworker.0 Request processed in 58us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096255.986282:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787096255.986285:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:36cee2c3-5860-4e4f-81d9-386cc3395e70:3628:1873906084443136:0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.986310:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084444160 00000100:00100000:2.0:1787096255.986314:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084444160 00000100:00100000:1.0:1787096255.986319:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084443648 00000100:00100000:1.0:1787096255.986324:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084443648 00000100:00100000:2.0:1787096255.986343:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787096255.986352:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1873906084443776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.986394:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787096255.986406:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084443648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.986426:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1873906084443776:12345-0@lo:400:kworker.0 Request processed in 74us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096255.986434:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787096255.986453:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787096255.986463:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084443648:12345-0@lo:400:kworker.0 Request processed in 59us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096255.986464:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1873906084444160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.986480:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787096255.986509:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1873906084444160:12345-0@lo:400:kworker.0 Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096255.986515:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787096255.986523:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084443648:0@lo:400:kworker.0 00010000:00080000:1.0:1787096255.986541:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a90178700 x1873906084444160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787096255.986546:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787096255.986551:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096255.986573:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a90178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1873906084444160:0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.986579:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1873906084443264:0@lo:400:kworker.0 00000100:00100000:2.0:1787096255.986598:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1873906084443776:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.986628:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1873906084443520:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.986642:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1873906084444032:0@lo:400:kworker.0 00000100:00100000:1.0:1787096255.986655:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084443392:0@lo:400:kworker.0 00010000:00080000:1.0:1787096255.986667:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a87947100 x1873906084443904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096255.986677:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1873906084443904:0@lo:400:kworker.0 00000001:02000400:3.0:1787096256.002949:0:19886:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 19:37:35 (1787096255) 00000100:00100000:3.0:1787096256.090410:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096256.090449:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096256.090463:0:6469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077053056 00000100:00100000:2.0:1787096256.090473:0:6469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077053056 00000100:00100000:1.0:1787096256.090507:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077053184 00000100:00100000:1.0:1787096256.090514:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077053184 00000100:00100000:2.0:1787096256.090525:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 288 00000100:00100000:2.0:1787096256.090537:0:6469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2408:x1873906077053056:12345-192.168.201.52@tcp:400:kworker.0 00000100:00080000:0.0:1787096256.090568:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096256.090584:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 167 00000100:00100000:1.0:1787096256.090598:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2408:x1873906077053184:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1787096256.090606:0:6469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88500050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2408:x1873906077053056:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096256.090612:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 288 00000100:00100000:1.0:1787096256.090651:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2408:x1873906077053184:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096256.090661:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 167 00010000:00010000:1.0:1787096256.176513:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096256.496560:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084444288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096256.496653:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096256.496706:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084444288 00000100:00100000:2.0:1787096256.496714:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084444288 00000100:00100000:2.0:1787096256.496764:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787096256.496779:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084444288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787096256.496811:0:6481:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787096256.496856:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084444288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096256.496862:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787096256.496930:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084444288:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787096256.560949:0:19934:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_10 needs >= 5 OSTs 00000100:00100000:0.0:1787096257.008490:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096257.008512:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a88e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084444416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787096257.008580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096257.008622:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084444416 00000100:00100000:1.0:1787096257.008632:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084444416 00000100:00100000:1.0:1787096257.008693:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787096257.008704:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084444416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787096257.008748:0:7980:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787096257.008794:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084444416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096257.008801:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787096257.008831:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a88e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084444416:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1787096257.009411:0:6456:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00010000:00010000:1.0:1787096257.009455:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d549 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009471:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d549 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009479:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d549 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009484:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096257.009488:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d549 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009496:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d549 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009514:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd21bc93c (ffff8c7a8b27a400) 00010000:00010000:1.0:1787096257.009518:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096257.009524:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d549 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009541:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d549 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009554:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d59d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009558:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d59d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009563:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d59d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009575:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096257.009578:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d59d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009582:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d59d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009588:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd21bc93c (ffff8c7a8b27a400) 00010000:00010000:1.0:1787096257.009590:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096257.009592:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d59d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009596:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d59d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd21bc93c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009609:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d5e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009613:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d5e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009617:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d5e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009620:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd762e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096257.009622:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d5e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009626:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d5e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009638:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff8c7a92c71b00) 00010000:00010000:1.0:1787096257.009640:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096257.009642:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d5e3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009646:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d5e3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009652:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009656:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009659:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009663:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c9a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096257.009665:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009669:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009673:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff8c7a92c71b00) 00010000:00010000:1.0:1787096257.009675:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096257.009676:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096257.009680:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d637 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1787096257.082915:0:19982:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 11: can create --ec 2+2 ================ 19:37:36 (1787096256) 00010000:00010000:0.0:1787096257.200533:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096257.559266:0:20031:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_11 needs >= 4 OSTs 00000001:02000400:2.0:1787096258.134727:0:20079:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a 00010000:00010000:0.0:1787096258.224495:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096258.694948:0:20127:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12b skipping ALWAYS excluded test 12b 00000001:02000400:0.0:1787096259.212182:0:20175:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12c: resync a file using both FLR and EC (without overstriping) ========================================================== 19:37:38 (1787096258) 00010000:00010000:0.0:1787096259.248478:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096259.707175:0:20223:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12c needs >= 8 OSTs 00010000:00010000:2.0:1787096260.273476:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096260.277515:0:20271:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12d: resync a file using both FLR and EC (with overstriping) ========================================================== 19:37:39 (1787096259) 00000001:02000400:1.0:1787096260.774754:0:20319:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12d needs >= 8 OSTs 00000100:00100000:3.0:1787096261.104496:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084444800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096261.104496:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084444928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096261.104518:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a88e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084444672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096261.104575:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36cee2c3-5860-4e4f-81d9-386cc3395e70:3627:1873906084444544:0@lo:400:kworker.0 00000100:00100000:3.0:1787096261.104581:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096261.104607:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084444800 00000100:00100000:1.0:1787096261.104614:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084444800 00000100:00100000:2.0:1787096261.104625:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096261.104639:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096261.104662:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c798328fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084445184:0@lo:400:kworker.0 00000100:00100000:3.0:1787096261.104673:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a878b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1873906084445440:0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.104687:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906084445056:0@lo:400:kworker.0 00000100:00100000:2.0:1787096261.104694:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096261.104698:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084444672 00000100:00100000:1.0:1787096261.104704:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084444672 00000100:00100000:3.0:1787096261.104721:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096261.104729:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c798390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906084445696:0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.104736:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787096261.104746:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084444800:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787096261.104752:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787096261.104757:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096261.104760:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1873906084445824:0@lo:400:kworker.0 00000100:00100000:2.0:1787096261.104769:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096261.104774:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00002000:00000024:1.0:1787096261.104783:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096261.104799:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084444672:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096261.104807:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096261.104808:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab3ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084446208:0@lo:400:kworker.0 00002000:00000024:0.0:1787096261.104831:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096261.104839:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084446336:0@lo:400:kworker.0 00000100:00100000:2.0:1787096261.104851:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096261.104865:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084444800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096261.104871:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787096261.104888:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787096261.104901:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a88e17480 x1873906084444672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096261.104902:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084444672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096261.104903:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084444544 00000100:00100000:1.0:1787096261.104909:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084444544 00000100:00100000:0.0:1787096261.104920:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787096261.104932:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a88e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084444672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096261.104933:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084444800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096261.104943:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787096261.104951:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3627:x1873906084444544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.104957:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096261.104976:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084445184 00000100:00100000:2.0:1787096261.104982:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084445184 00000100:00100000:3.0:1787096261.104985:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084445440 00000100:00100000:0.0:1787096261.104986:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084445568:0@lo:400:kworker.0 00000100:00100000:3.0:1787096261.104993:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084445440 00000100:00100000:1.0:1787096261.104993:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88501450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3627:x1873906084444544:12345-0@lo:400:kworker.0 Request processed in 42us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096261.105002:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787096261.105025:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096261.105031:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787096261.105041:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084445184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096261.105050:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084445696 00000100:00100000:0.0:1787096261.105050:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906084446080:0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105055:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084445824 00000100:00100000:3.0:1787096261.105056:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084445696 00000100:00100000:1.0:1787096261.105059:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084445824 00000100:00100000:3.0:1787096261.105093:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084445056 00000100:00100000:3.0:1787096261.105098:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084445056 00000100:00100000:1.0:1787096261.105100:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787096261.105102:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096261.105106:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084445184:12345-0@lo:400:kworker.0 Request processed in 65us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096261.105118:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787096261.105118:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1873906084445440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105124:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084446592:0@lo:400:kworker.0 00000100:00100000:3.0:1787096261.105125:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084446080 00000100:00100000:3.0:1787096261.105129:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084446080 00000100:00100000:2.0:1787096261.105135:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084445568 00000100:00100000:2.0:1787096261.105139:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084445568 00000100:00100000:3.0:1787096261.105155:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787096261.105163:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906084445696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096261.105178:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787096261.105178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096261.105194:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105201:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1873906084445440:12345-0@lo:400:kworker.0 Request processed in 87us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096261.105218:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906084445696:12345-0@lo:400:kworker.0 Request processed in 52us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096261.105219:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36cee2c3-5860-4e4f-81d9-386cc3395e70:3627:1873906084444544:0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105225:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787096261.105237:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787096261.105240:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084445568:12345-0@lo:400:kworker.0 Request processed in 50us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096261.105244:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084445568:0@lo:400:kworker.0 00000100:00100000:2.0:1787096261.105251:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787096261.105257:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787096261.105269:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1873906084445824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105273:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787096261.105281:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787096261.105285:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a88e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084445312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096261.105291:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787096261.105298:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906084445056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096261.105308:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906084446080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105318:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1873906084445824:12345-0@lo:400:kworker.0 Request processed in 51us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096261.105328:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096261.105330:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787096261.105387:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906084445056:12345-0@lo:400:kworker.0 Request processed in 62us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096261.105396:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787096261.105399:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906084445952:0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105426:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787096261.105435:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096261.105436:0:9462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084446208 00000100:00080000:3.0:1787096261.105441:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096261.105442:0:9462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084446208 00000100:00100000:0.0:1787096261.105446:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084446464:0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105469:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787096261.105470:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096261.105502:0:9462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084446336 00000100:00100000:1.0:1787096261.105507:0:9462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084446336 00000100:00100000:3.0:1787096261.105510:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a878b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1873906084445440:0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105510:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906084445056:0@lo:400:kworker.0 00010000:00080000:3.0:1787096261.105544:0:3629:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7983909f80 x1873906084445824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096261.105545:0:9462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084446592 00000100:00100000:1.0:1787096261.105551:0:9462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084446592 00000100:00100000:0.0:1787096261.105554:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084446464 00000100:00100000:0.0:1787096261.105559:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084446464 00000100:00100000:3.0:1787096261.105567:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1873906084445824:0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105581:0:9462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787096261.105591:0:9462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084446208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105601:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787096261.105612:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096261.105612:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084446336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105632:0:9462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084446208:12345-0@lo:400:kworker.0 Request processed in 44us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096261.105639:0:9462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787096261.105659:0:9453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787096261.105668:0:9462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787096261.105674:0:9453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084446592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105675:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084446336:12345-0@lo:400:kworker.0 Request processed in 61us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096261.105687:0:9462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084446464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105693:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787096261.105728:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906084446080:12345-0@lo:400:kworker.0 Request processed in 424us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096261.105740:0:9453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084446592:12345-0@lo:400:kworker.0 Request processed in 70us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096261.105741:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787096261.105741:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084445952 00000100:00100000:1.0:1787096261.105748:0:9462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084446464:12345-0@lo:400:kworker.0 Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096261.105748:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084445952 00000100:00100000:3.0:1787096261.105759:0:9453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787096261.105766:0:9462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787096261.105804:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096261.105808:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787096261.105827:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906084445952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105846:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084445312 00000100:00100000:1.0:1787096261.105850:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084445312 00000100:00100000:3.0:1787096261.105863:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084446336:0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105890:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787096261.105895:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906084445952:12345-0@lo:400:kworker.0 Request processed in 71us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096261.105901:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084445312:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096261.105908:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c798390aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906084445696:0@lo:400:kworker.0 00000100:00100000:0.0:1787096261.105909:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787096261.105917:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906084445952:0@lo:400:kworker.0 00002000:00000024:1.0:1787096261.105928:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1787096261.105940:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7ab3ebbb80 x1873906084446208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787096261.105943:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abd602a00 x1873906084446464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096261.105944:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096261.105964:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084445312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096261.105983:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084446464:0@lo:400:kworker.0 00000100:00100000:2.0:1787096261.105984:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab3ebbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084446208:0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.105985:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787096261.105985:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084444928 00000100:00100000:0.0:1787096261.105990:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084444928 00000100:00100000:2.0:1787096261.106011:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c798328fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084445184:0@lo:400:kworker.0 00010000:00080000:3.0:1787096261.106023:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7ab3ebb100 x1873906084446080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096261.106032:0:10997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787096261.106040:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906084446080:0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.106047:0:10997:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084444928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787096261.106057:0:10997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096261.106061:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084446592:0@lo:400:kworker.0 00000100:00100000:1.0:1787096261.106094:0:10997:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084444928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096261.106098:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a88e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084445312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096261.106104:0:10997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1787096261.106120:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abd5e8000 x1873906084444928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096261.106134:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084444928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096261.211068:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096261.211103:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096261.211131:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096261.211134:0:6469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077053312 00000100:00100000:3.0:1787096261.211144:0:6469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077053312 00000100:00100000:1.0:1787096261.211155:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077053440 00000100:00100000:2.0:1787096261.211162:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077053568 00000100:00100000:1.0:1787096261.211163:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077053440 00000100:00100000:2.0:1787096261.211176:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077053568 00000100:00100000:3.0:1787096261.211199:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 290 00000100:00100000:3.0:1787096261.211214:0:6469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2408:x1873906077053312:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1787096261.211231:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:2.0:1787096261.211247:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00100000:1.0:1787096261.211248:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2409:x1873906077053440:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1787096261.211264:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2408:x1873906077053568:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1787096261.211291:0:6469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2408:x1873906077053312:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096261.211298:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 290 00000100:00100000:1.0:1787096261.211306:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2409:x1873906077053440:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 65us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096261.211315:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2408:x1873906077053568:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 53us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096261.211320:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 174 00000100:00100000:2.0:1787096261.211332:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 175 00000100:00080000:1.0:1787096261.211376:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787096261.211381:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787096261.296445:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096261.321874:0:20367:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 19:37:40 (1787096260) 00000100:00100000:1.0:1787096261.617490:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787096261.617516:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084446720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787096261.617586:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096261.617616:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084446720 00000100:00100000:2.0:1787096261.617626:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084446720 00000100:00100000:2.0:1787096261.617681:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787096261.617693:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084446720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787096261.617730:0:6482:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787096261.617778:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084446720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096261.617799:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787096261.617849:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084446720:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787096261.830394:0:20416:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_13 needs >= 4 OSTs 00000100:00100000:1.0:1787096262.128583:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a88e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084446848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096262.128675:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096262.128727:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084446848 00000100:00100000:3.0:1787096262.128737:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084446848 00000100:00100000:3.0:1787096262.128818:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787096262.128829:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084446848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787096262.128861:0:6481:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787096262.128918:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084446848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096262.128927:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787096262.128964:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a88e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084446848:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787096262.320501:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096262.432900:0:20464:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 19:37:41 (1787096261) 00000001:02000400:0.0:1787096262.959723:0:20512:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_20 needs >= 4 OSTs 00010000:00010000:0.0:1787096263.344530:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096263.525824:0:20560:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22: test that lfs mirror read from ec does not change eof ========================================================== 19:37:42 (1787096262) 00000001:02000400:3.0:1787096264.073699:0:20608:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22 needs >= 8 OSTs 00010000:00010000:2.0:1787096264.368523:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096264.659186:0:20656:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28b: test that lfs mirror verify for ec does not change eof ========================================================== 19:37:43 (1787096263) 00000001:02000400:3.0:1787096265.139665:0:20704:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28b needs >= 8 OSTs 00010000:00010000:0.0:1787096265.392529:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096265.706165:0:20752:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28c: test that reading past parity data returns zeros ========================================================== 19:37:44 (1787096264) 00000100:00100000:2.0:1787096266.224561:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a88e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084447104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096266.224564:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906084447360:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.224639:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36cee2c3-5860-4e4f-81d9-386cc3395e70:3626:1873906084446976:0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.224674:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096266.224716:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096266.224724:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096266.224751:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1873906084447616:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.224770:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084447488:0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.224795:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a90178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084447744:0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.224795:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096266.224812:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096266.224843:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1873906084448128:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.224844:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1873906084448000:0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.224858:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096266.224904:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096266.224908:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1873906084448256:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.224913:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084447232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096266.224934:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084448640:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.224980:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096266.224988:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096266.224989:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096266.225014:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084447872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096266.225055:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084448768:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.225058:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096266.225099:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084447104 00000100:00100000:1.0:1787096266.225102:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1873906084448384:0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.225106:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084447104 00000100:00100000:3.0:1787096266.225117:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096266.225153:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096266.225192:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084448896:0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.225194:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084447232 00000100:00100000:3.0:1787096266.225197:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084447360 00000100:00100000:3.0:1787096266.225205:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084447360 00000100:00100000:2.0:1787096266.225206:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084447232 00000100:00100000:1.0:1787096266.225223:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096266.225247:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084447872 00000100:00100000:2.0:1787096266.225251:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084447872 00000100:00100000:3.0:1787096266.225263:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084447616 00000100:00100000:3.0:1787096266.225267:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084447616 00000100:00100000:2.0:1787096266.225288:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787096266.225293:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084446976 00000100:00100000:3.0:1787096266.225297:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084448128 00000100:00100000:3.0:1787096266.225300:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084448128 00000100:00100000:1.0:1787096266.225300:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084446976 00000100:00100000:2.0:1787096266.225308:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084447104:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096266.225327:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084448256 00000100:00100000:3.0:1787096266.225332:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084448256 00002000:00000024:2.0:1787096266.225347:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096266.225408:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084448384 00000100:00100000:3.0:1787096266.225412:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084448384 00000100:00100000:1.0:1787096266.225414:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787096266.225430:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3626:x1873906084446976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.225444:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787096266.225455:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906084447360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.225488:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88502450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3626:x1873906084446976:12345-0@lo:400:kworker.0 Request processed in 61us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096266.225510:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787096266.225524:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906084447360:12345-0@lo:400:kworker.0 Request processed in 72us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096266.225532:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787096266.225568:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787096266.225573:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084447104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 274us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096266.225584:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1873906084447616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.225589:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787096266.225597:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787096266.225612:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1873906084448128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.225624:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787096266.225632:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084447232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787096266.225645:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096266.225685:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1873906084447616:12345-0@lo:400:kworker.0 Request processed in 103us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096266.225696:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1873906084448128:12345-0@lo:400:kworker.0 Request processed in 87us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096266.225720:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787096266.225721:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084447232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096266.225731:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787096266.225732:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787096266.225753:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787096266.225769:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1873906084448256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.225772:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787096266.225782:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787096266.225786:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084447872:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096266.225804:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1873906084448384:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787096266.225807:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096266.225837:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1873906084448256:12345-0@lo:400:kworker.0 Request processed in 77us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096266.225847:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787096266.225865:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084447872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096266.225874:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787096266.225880:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1873906084448384:12345-0@lo:400:kworker.0 Request processed in 82us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096266.225892:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787096266.225899:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084447488 00000100:00100000:3.0:1787096266.225904:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084447488 00000100:00100000:2.0:1787096266.225908:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084448640 00000100:00100000:2.0:1787096266.225913:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084448640 00000100:00080000:1.0:1787096266.225948:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787096266.225956:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787096266.225965:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787096266.225968:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096266.225984:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084448768 00000100:00100000:3.0:1787096266.225986:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084447744 00000100:00100000:2.0:1787096266.225988:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084448768 00000100:00100000:3.0:1787096266.225995:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084447744 00000100:00100000:1.0:1787096266.226004:0:9462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084448896 00000100:00100000:1.0:1787096266.226011:0:9462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084448896 00000100:00100000:2.0:1787096266.226026:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787096266.226040:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c798328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084448640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.226047:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787096266.226058:0:9462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787096266.226062:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084447488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.226081:0:9462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084448768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.226147:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084447488:12345-0@lo:400:kworker.0 Request processed in 85us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096266.226160:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c798328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084448640:12345-0@lo:400:kworker.0 Request processed in 123us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096266.226164:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787096266.226166:0:9462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084448768:12345-0@lo:400:kworker.0 Request processed in 85us (1048us total) trans 0 rc 0/0 00000001:02000400:0.0:1787096266.226167:0:20800:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28c needs >= 8 OSTs 00000100:00100000:2.0:1787096266.226183:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787096266.226198:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787096266.226200:0:9462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787096266.226209:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787096266.226219:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084447744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.226220:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084448896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787096266.226234:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787096266.226250:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096266.226282:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084448512:0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.226307:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084447744:12345-0@lo:400:kworker.0 Request processed in 97us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096266.226318:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787096266.226327:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983341f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084448896:12345-0@lo:400:kworker.0 Request processed in 102us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096266.226335:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096266.226342:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787096266.226422:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084448512 00000100:00100000:3.0:1787096266.226427:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084448000 00000100:00100000:2.0:1787096266.226428:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084448512 00000100:00100000:1.0:1787096266.226433:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084449024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096266.226436:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084448000 00000100:00100000:2.0:1787096266.226468:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787096266.226479:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096266.226484:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084448512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.226516:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787096266.226529:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1873906084448000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.226532:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36cee2c3-5860-4e4f-81d9-386cc3395e70:3626:1873906084446976:0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.226541:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084448512:12345-0@lo:400:kworker.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096266.226551:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787096266.226560:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084447488:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.226600:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1873906084448000:0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.226601:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1873906084448000:12345-0@lo:400:kworker.0 Request processed in 74us (350us total) trans 0 rc 0/0 00010000:00080000:2.0:1787096266.226616:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a87944e00 x1873906084448128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096266.226628:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00080000:1.0:1787096266.226634:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a87947b80 x1873906084448512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096266.226655:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1873906084448128:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.226656:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084448512:0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.226692:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084448640:0@lo:400:kworker.0 00010000:00080000:2.0:1787096266.226735:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a88e15c00 x1873906084447104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096266.226737:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1873906084448256:0@lo:400:kworker.0 00000100:00080000:1.0:1787096266.226746:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096266.226774:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a88e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084447104:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787096266.226785:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7983887800 x1873906084448768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787096266.226795:0:3629:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abd5e9f80 x1873906084447232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096266.226801:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1873906084447616:0@lo:400:kworker.0 00000100:00100000:3.0:1787096266.226863:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084448768:0@lo:400:kworker.0 00000100:00100000:1.0:1787096266.226870:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084447232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096266.226893:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084449024 00000100:00100000:3.0:1787096266.226895:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906084447360:0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.226909:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084449024 00000100:00100000:1.0:1787096266.226914:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084447872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096266.226923:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a90178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084447744:0@lo:400:kworker.0 00010000:00080000:1.0:1787096266.226944:0:3629:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a87945880 x1873906084448384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096266.226960:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787096266.226961:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1873906084448384:0@lo:400:kworker.0 00000100:00100000:2.0:1787096266.226982:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084449024:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096266.226988:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084448896:0@lo:400:kworker.0 00002000:00000024:2.0:1787096266.227001:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096266.227067:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084449024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096266.227075:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787096266.227104:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084449024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096266.330315:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096266.330398:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096266.330405:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077053824 00000100:00100000:1.0:1787096266.330415:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077053824 00000100:00100000:0.0:1787096266.330437:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096266.330447:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077053696 00000100:00100000:2.0:1787096266.330460:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077053696 00000100:00100000:0.0:1787096266.330469:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077053952 00000100:00100000:0.0:1787096266.330474:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077053952 00000100:00080000:3.0:1787096266.330488:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787096266.330494:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096266.330501:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:2.0:1787096266.330507:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 292 00000100:00100000:3.0:1787096266.330516:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 183 00000100:00100000:2.0:1787096266.330520:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5469a594-d695-447b-b0fa-7bef4580840e+9:2409:x1873906077053696:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1787096266.330520:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2408:x1873906077053824:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:3.0:1787096266.330530:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2409:x1873906077053952:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1787096266.330597:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88501050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5469a594-d695-447b-b0fa-7bef4580840e+9:2409:x1873906077053696:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096266.330607:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 292 00000100:00100000:3.0:1787096266.330608:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2409:x1873906077053952:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 77us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096266.330608:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2408:x1873906077053824:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 93us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096266.330624:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 182 00000100:00100000:3.0:1787096266.330631:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 183 00010000:00010000:1.0:1787096266.416513:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096266.736472:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084449152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787096266.736541:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096266.736581:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084449152 00000100:00100000:3.0:1787096266.736591:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084449152 00000100:00100000:3.0:1787096266.736649:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787096266.736658:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084449152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787096266.736690:0:7407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787096266.736755:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab3ebbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084449152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096266.736762:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787096266.736785:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084449152:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787096266.810893:0:20848:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 19:37:45 (1787096265) 00000100:00100000:3.0:1787096267.248508:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084449280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787096267.248581:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096267.248625:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084449280 00000100:00100000:0.0:1787096267.248634:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084449280 00000100:00100000:0.0:1787096267.248701:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787096267.248712:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c798390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084449280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787096267.248743:0:7980:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787096267.248788:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c798390aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084449280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096267.248796:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787096267.248826:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084449280:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787096267.333001:0:20896:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31b needs >= 8 OSTs 00010000:00010000:0.0:1787096267.440562:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096267.897228:0:20944:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 19:37:47 (1787096267) 00000001:02000400:3.0:1787096268.448643:0:20992:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31c needs >= 8 OSTs 00010000:00010000:2.0:1787096268.464466:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096269.021578:0:21041:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31d: test that size of parity mirror is 1*2*64k ========================================================== 19:37:48 (1787096268) 00010000:00010000:0.0:1787096269.488478:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096269.522570:0:21089:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31d needs >= 8 OSTs 00000001:02000400:2.0:1787096270.047180:0:21137:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 30d: test that size of parity mirror is 22*64k ========================================================== 19:37:49 (1787096269) 00010000:00010000:1.0:1787096270.512457:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096270.554338:0:21185:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_30d needs >= 8 OSTs 00000001:02000400:1.0:1787096271.065421:0:21233:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21a: migrate plain file to EC layout === 19:37:50 (1787096270) 00000100:00100000:0.0:1787096271.344533:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787096271.344561:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084449408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096271.344658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096271.344697:0:10997:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084449408 00000100:00100000:2.0:1787096271.344706:0:10997:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084449408 00000100:00100000:2.0:1787096271.344760:0:10997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787096271.344769:0:10997:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084449408:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787096271.344773:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787096271.344797:0:10997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096271.344842:0:10997:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084449408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096271.344855:0:10997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1787096271.344885:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7ab3ebb100 x1873906084449408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096271.344907:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084449408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096271.345450:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084449664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096271.345459:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084449536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096271.345481:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084449792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096271.345489:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096271.345527:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096271.345551:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084449664 00000100:00100000:2.0:1787096271.345556:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084449664 00000100:00100000:3.0:1787096271.345579:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1873906084450048:0@lo:400:kworker.0 00000100:00100000:2.0:1787096271.345591:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084449536 00000100:00100000:2.0:1787096271.345594:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084449536 00000100:00100000:2.0:1787096271.345631:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787096271.345640:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096271.345642:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084449664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787096271.345663:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096271.345678:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1873906084450560:0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.345698:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084450176:0@lo:400:kworker.0 00000100:00100000:2.0:1787096271.345699:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084449664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096271.345714:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787096271.345718:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096271.345730:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787096271.345738:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a90178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084449536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787096271.345747:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096271.345750:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084451072:0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.345759:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096271.345777:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a90178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084449536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096271.345783:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787096271.345798:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1873906084450688:0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.345803:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096271.345819:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36cee2c3-5860-4e4f-81d9-386cc3395e70:3629:1873906084449920:0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.345829:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096271.345854:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab3ebb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084449536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096271.345871:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096271.345871:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084449664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096271.345892:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084450048 00000100:00100000:3.0:1787096271.345898:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084450048 00000100:00100000:2.0:1787096271.345911:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c798380a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084450432:0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.345920:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084450176 00000100:00100000:0.0:1787096271.345925:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084450176 00000100:00100000:2.0:1787096271.345950:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096271.345961:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084450432 00000100:00100000:0.0:1787096271.345966:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084450432 00000100:00100000:3.0:1787096271.345968:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084450560 00000100:00100000:2.0:1787096271.345974:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c798380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1873906084450944:0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.345985:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084450560 00000100:00100000:0.0:1787096271.345999:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787096271.346005:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096271.346015:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084450176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.346022:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084450688 00000100:00100000:3.0:1787096271.346027:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084450688 00000100:00100000:2.0:1787096271.346037:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787096271.346048:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1873906084450304:0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.346053:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084450944 00000100:00100000:3.0:1787096271.346057:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084450944 00000100:00100000:0.0:1787096271.346064:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084450176:12345-0@lo:400:kworker.0 Request processed in 53us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096271.346071:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787096271.346088:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787096271.346093:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096271.346094:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787096271.346104:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1873906084450048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.346108:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084450432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096271.346115:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1873906084450816:0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.346164:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084450432:12345-0@lo:400:kworker.0 Request processed in 58us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096271.346165:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096271.346175:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1873906084450048:12345-0@lo:400:kworker.0 Request processed in 73us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096271.346175:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787096271.346188:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787096271.346196:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c798380a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084450432:0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.346197:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084450304 00000100:00100000:0.0:1787096271.346202:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084450304 00000100:00100000:3.0:1787096271.346210:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084450816 00000100:00100000:3.0:1787096271.346216:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084450816 00000100:00100000:0.0:1787096271.346228:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787096271.346236:0:6469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084449920 00000100:00100000:0.0:1787096271.346238:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1873906084450560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096271.346242:0:6469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084449920 00000100:00100000:3.0:1787096271.346249:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787096271.346262:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1873906084450688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.346273:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1873906084450560:12345-0@lo:400:kworker.0 Request processed in 39us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096271.346279:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787096271.346283:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787096271.346293:0:6469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3629:x1873906084449920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.346300:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787096271.346312:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1873906084450688:12345-0@lo:400:kworker.0 Request processed in 52us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096271.346312:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1873906084450944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.346330:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787096271.346352:0:6469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3629:x1873906084449920:12345-0@lo:400:kworker.0 Request processed in 61us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096271.346378:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787096271.346386:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787096271.346391:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1873906084450944:12345-0@lo:400:kworker.0 Request processed in 82us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096271.346404:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1873906084450304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.346404:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787096271.346415:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096271.346438:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787096271.346450:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1873906084450816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096271.346458:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084449792 00000100:00100000:3.0:1787096271.346459:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1873906084450304:12345-0@lo:400:kworker.0 Request processed in 61us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096271.346462:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084449792 00000100:00100000:3.0:1787096271.346471:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787096271.346498:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787096271.346503:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1873906084450816:12345-0@lo:400:kworker.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096271.346508:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084449792:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787096271.346511:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084451072 00000100:00100000:3.0:1787096271.346518:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084451072 00000100:00100000:0.0:1787096271.346520:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00002000:00000024:2.0:1787096271.346523:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096271.346562:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1873906084449792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096271.346567:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787096271.346573:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787096271.346574:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084450176:0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.346582:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1873906084451072:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787096271.346591:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7983809880 x1873906084450688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096271.346600:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1873906084450688:0@lo:400:kworker.0 00010000:00080000:2.0:1787096271.346611:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abd5eea00 x1873906084449792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096271.346642:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084449792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787096271.346648:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084451072:12345-0@lo:400:kworker.0 Request processed in 68us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096271.346657:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787096271.346673:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096271.346678:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1873906084450304:0@lo:400:kworker.0 00000100:00080000:0.0:1787096271.346679:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787096271.346683:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787096271.346689:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096271.346703:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1873906084450816:0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.346713:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1873906084450560:0@lo:400:kworker.0 00000100:00100000:2.0:1787096271.346716:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:36cee2c3-5860-4e4f-81d9-386cc3395e70:3629:1873906084449920:0@lo:400:kworker.0 00010000:00080000:3.0:1787096271.346742:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7983809180 x1873906084451072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787096271.346742:0:3629:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c798380a300 x1873906084450944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096271.346769:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c798380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1873906084450944:0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.346777:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084451072:0@lo:400:kworker.0 00000100:00100000:3.0:1787096271.346795:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1873906084450048:0@lo:400:kworker.0 00000100:00100000:0.0:1787096271.450991:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096271.451045:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077054208 00000100:00100000:0.0:1787096271.451046:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096271.451060:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077054208 00000100:00100000:0.0:1787096271.451094:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096271.451095:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077054080 00000100:00100000:1.0:1787096271.451101:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077054080 00000100:00100000:2.0:1787096271.451131:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077054336 00000100:00100000:2.0:1787096271.451135:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077054336 00000100:00100000:0.0:1787096271.451146:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:1.0:1787096271.451151:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 294 00000100:00100000:0.0:1787096271.451167:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2409:x1873906077054208:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1787096271.451168:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5469a594-d695-447b-b0fa-7bef4580840e+9:2408:x1873906077054080:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:2.0:1787096271.451182:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00100000:2.0:1787096271.451192:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2408:x1873906077054336:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1787096271.451243:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2409:x1873906077054208:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096271.451245:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5469a594-d695-447b-b0fa-7bef4580840e+9:2408:x1873906077054080:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096271.451246:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2408:x1873906077054336:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096271.451262:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 190 00000100:00100000:1.0:1787096271.451266:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 294 00000100:00100000:2.0:1787096271.451271:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 191 00000100:00080000:2.0:1787096271.451298:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787096271.451301:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787096271.536602:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096271.558711:0:21281:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21a needs >= 3 OSTs 00000100:00100000:3.0:1787096271.856534:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787096271.856555:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084451200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096271.856646:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096271.856704:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084451200 00000100:00100000:0.0:1787096271.856714:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084451200 00000100:00100000:0.0:1787096271.856770:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787096271.856783:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab3ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084451200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787096271.856828:0:6482:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787096271.856888:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab3ebb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084451200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096271.856899:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787096271.856925:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084451200:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787096272.103567:0:21329:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21b: migrate EC file to plain layout === 19:37:51 (1787096271) 00000100:00100000:1.0:1787096272.368510:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787096272.368536:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084451328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096272.368631:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096272.368674:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084451328 00000100:00100000:0.0:1787096272.368684:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084451328 00000100:00100000:0.0:1787096272.368734:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787096272.368743:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084451328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787096272.368775:0:6481:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787096272.368825:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084451328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096272.368831:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787096272.368870:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084451328:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787096272.560575:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096272.565189:0:21377:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21b needs >= 3 OSTs 00000001:02000400:3.0:1787096273.084813:0:21425:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21c: migrate between different EC configurations ========================================================== 19:37:52 (1787096272) 00000001:02000400:2.0:1787096273.553669:0:21473:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21c needs >= 4 OSTs 00010000:00010000:0.0:1787096273.584488:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096274.070871:0:21521:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21d: migrate PFL file to EC layout ===== 19:37:53 (1787096273) 00000001:02000400:3.0:1787096274.606936:0:21569:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21d needs >= 3 OSTs 00010000:00010000:1.0:1787096274.609131:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096275.088724:0:21617:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 19:37:54 (1787096274) 00000001:02000400:1.0:1787096275.545667:0:21665:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22a needs >= 6 OSTs 00010000:00010000:0.0:1787096275.632477:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096276.116655:0:21714:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 23a: truncate EC file to smaller size == 19:37:55 (1787096275) 00000100:00100000:0.0:1787096276.172323:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096276.172399:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077054464 00000100:00100000:3.0:1787096276.172411:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077054464 00000100:00080000:2.0:1787096276.172460:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096276.172479:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:3.0:1787096276.172493:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:33710:x1873906077054464:12345-192.168.201.52@tcp:41:stat.0 00000004:00000024:3.0:1787096276.172564:0:6477:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1787096276.172661:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:33710:x1873906077054464:12345-192.168.201.52@tcp:41:stat.0 Request processed in 172us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.172671:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 143 00000100:00100000:0.0:1787096276.187468:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096276.187515:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077054592 00000100:00100000:2.0:1787096276.187526:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077054592 00000100:00100000:2.0:1787096276.187622:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:2.0:1787096276.187635:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:33715:x1873906077054592:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096276.187664:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096276.187688:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d64c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41090 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.187757:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.187771:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.187800:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096276.187852:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096276.187856:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096276.187877:0:6476:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.187921:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d64c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.187937:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.187947:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a86975a00) 00010000:00010000:2.0:1787096276.187950:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096276.187954:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7aa2751c00, rc 0) 00000100:00100000:2.0:1787096276.188013:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+6:33715:x1873906077054592:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 381us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.188020:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 144 00000100:00100000:0.0:1787096276.189346:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.189433:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077054720 00000100:00100000:1.0:1787096276.189441:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077054720 00000100:00100000:1.0:1787096276.189482:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:1.0:1787096276.189498:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:33715:x1873906077054720:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096276.189511:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096276.189527:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d65a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b41097 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189612:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189626:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189635:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189646:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189651:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189656:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189687:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189692:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189697:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189710:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096276.189714:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189720:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189730:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a86975a00) 00010000:00010000:1.0:1787096276.189732:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096276.189736:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189740:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189749:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189753:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189757:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189761:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096276.189763:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189766:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189777:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff8c7a8b27a800) 00010000:00010000:1.0:1787096276.189779:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096276.189781:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189784:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d668 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189816:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d65a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41097 expref: 7 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189823:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a86975a00) 00010000:00010000:1.0:1787096276.189824:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096276.189827:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d65a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41097 expref: 7 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.189833:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881800, rc 0) 00000100:00100000:1.0:1787096276.189871:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:33715:x1873906077054720:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 374us (526us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096276.189879:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 145 00000100:00100000:0.0:1787096276.192140:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096276.192190:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077054848 00000100:00100000:3.0:1787096276.192196:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077054848 00000100:00100000:3.0:1787096276.192235:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:3.0:1787096276.192244:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:33715:x1873906077054848:12345-192.168.201.52@tcp:700:lfs.0 00000100:00080000:2.0:1787096276.192301:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787096276.192308:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:33715:x1873906077054848:12345-192.168.201.52@tcp:700:lfs.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.192316:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 3 00000100:00100000:0.0:1787096276.193327:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096276.193392:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077055104 00000100:00100000:3.0:1787096276.193398:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077055104 00000100:00100000:3.0:1787096276.193439:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 146 00000100:00100000:3.0:1787096276.193448:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:33715:x1873906077055104:12345-192.168.201.52@tcp:36:lfs.0 00000004:00080000:3.0:1787096276.194038:0:6477:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 561us 00000100:00100000:3.0:1787096276.200074:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID:6477:1873906084451456:0@lo:900:mdt00_001.0 00000100:00100000:3.0:1787096276.200127:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.200175:0:6487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084451456 00000100:00100000:1.0:1787096276.200183:0:6487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084451456 00000100:00100000:3.0:1787096276.200195:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787096276.200228:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787096276.200236:0:6487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:6477:x1873906084451456:12345-0@lo:900:mdt00_001.0 00000100:00100000:1.0:1787096276.200287:0:6487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:6477:x1873906084451456:12345-0@lo:900:mdt00_001.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.200292:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787096276.200311:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID:6477:1873906084451456:0@lo:900:mdt00_001.0 00000100:00100000:3.0:1787096276.200395:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084451584:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787096276.200432:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.200474:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084451584 00000100:00100000:1.0:1787096276.200479:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084451584 00000100:00100000:3.0:1787096276.200480:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787096276.200511:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787096276.200520:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:6477:x1873906084451584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.200605:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:6477:x1873906084451584:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.200617:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787096276.200645:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084451584:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787096276.200713:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084451712:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787096276.200737:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.200759:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787096276.200781:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084451712 00000100:00100000:1.0:1787096276.200785:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084451712 00000100:00100000:1.0:1787096276.200819:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787096276.200830:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6477:x1873906084451712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.200898:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6477:x1873906084451712:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.200903:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084451712:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.200911:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787096276.200943:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084451840:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787096276.200963:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.200994:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787096276.201061:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084451840 00000100:00100000:2.0:1787096276.201071:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084451840 00000100:00100000:2.0:1787096276.201124:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787096276.201136:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6477:x1873906084451840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787096276.201250:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6477:x1873906084451840:12345-0@lo:1000:mdt00_001.0 Request processed in 115us (283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787096276.201265:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787096276.201271:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084451840:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787096276.201320:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.201327:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.201335:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096276.201343:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084451968:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787096276.201395:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.201417:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787096276.201499:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084451968 00000100:00100000:0.0:1787096276.201507:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084451968 00000100:00100000:0.0:1787096276.201559:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787096276.201570:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:6477:x1873906084451968:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787096276.201581:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096276.201594:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d66f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.201624:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 5 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.201635:0:6481:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d66f expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.201662:0:6481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 5 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.201675:0:6481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 5 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096276.201690:0:6481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838a9180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6481:1873906084452096:192.168.201.52@tcp:104: 00000100:00100000:0.0:1787096276.201754:0:6481:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831ab600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096276.202837:0:6481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838a9180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6481:1873906084452096:192.168.201.52@tcp:104: 00010000:00010000:3.0:1787096276.202872:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d66f expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.202880:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a86975a00) 00010000:00010000:3.0:1787096276.202882:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096276.202885:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d66f expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.202893:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763a00, rc 0) 00000100:00100000:0.0:1787096276.202915:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096276.202946:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6477:x1873906084451968:12345-0@lo:101:mdt00_001.0 Request processed in 1376us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.202971:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084451968:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096276.202984:0:6477:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096276.202992:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:1.0:1787096276.202992:0:6477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096276.203038:0:6462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077055232 00000100:00100000:2.0:1787096276.203047:0:6462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077055232 00010000:00010000:2.0:1787096276.203076:0:6462:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 6 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096276.203122:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:2.0:1787096276.203132:0:6462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+6:2406:x1873906077055232:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096276.203145:0:6462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096276.203152:0:6462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 6 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.203166:0:6462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 6 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.203195:0:6462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d653 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b41090 expref: 6 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.203212:0:6462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a86975a00) 00010000:00010000:2.0:1787096276.203218:0:6462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d66f expref: 5 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.203240:0:6462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50d66f expref: 5 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.203250:0:6462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x9eebb2eb7f50d66f expref: 5 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.203279:0:6462:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d66f expref: 5 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096276.203290:0:6462:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983920a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6462:1873906084452224:0@lo:105: 00000100:00100000:2.0:1787096276.203333:0:6462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096276.203445:0:8373:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787096276.203450:0:6462:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c798228e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787096276.203463:0:8373:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084452224 00000100:00100000:0.0:1787096276.203469:0:8373:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084452224 00000100:00100000:0.0:1787096276.203506:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787096276.203515:0:8373:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79832b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6462:x1873906084452224:12345-0@lo:105: 00010000:00010000:0.0:1787096276.203528:0:8373:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.203552:0:8373:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.203572:0:8373:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.203579:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.203584:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.203593:0:8373:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.203614:0:8373:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c7a869c8c00) 00010000:00010000:1.0:1787096276.203659:0:6477:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096276.203667:0:8373:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79832b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6462:x1873906084452224:12345-0@lo:105: Request processed in 149us (329us total) trans 0 rc 0/0 00010000:00010000:1.0:1787096276.203677:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096276.203692:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787096276.203701:0:6462:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983920a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6462:1873906084452224:0@lo:105: 00000004:00080000:1.0:1787096276.203709:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096276.203729:0:6462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096276.203765:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.203773:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.203783:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096276.203794:0:6462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2406:x1873906077055232:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 653us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.203811:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 53 00000100:00100000:1.0:1787096276.203818:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452352:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787096276.203862:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.203904:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a87ed43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096276.203925:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084452352 00000100:00100000:0.0:1787096276.203932:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084452352 00000100:00100000:0.0:1787096276.203968:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787096276.203975:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:6477:x1873906084452352:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787096276.203985:0:7980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096276.203998:0:7980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d684 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d67d expref: -99 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.204015:0:7980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d684 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d67d expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.204038:0:7980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d684 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d67d expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.204044:0:7980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff8c7a92c71700) 00010000:00010000:0.0:1787096276.204046:0:7980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096276.204049:0:7980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762e00, rc 0) 00000100:00100000:0.0:1787096276.204106:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452352:12345-0@lo:101:mdt00_001.0 Request processed in 132us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096276.204111:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787096276.204189:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452352:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096276.204208:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.204225:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096276.204243:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787096276.204276:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452480:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.204317:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.204350:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a87ed4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096276.204435:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084452480 00000100:00100000:3.0:1787096276.204445:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084452480 00000100:00100000:3.0:1787096276.204522:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787096276.204566:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787096276.204652:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452480:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.204663:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787096276.204697:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452480:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.204749:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452608:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.204782:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.204811:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a87ed4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787096276.204837:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084452608 00000100:00100000:2.0:1787096276.204845:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084452608 00000100:00100000:2.0:1787096276.204884:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787096276.204892:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787096276.204974:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452608:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (189us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787096276.204982:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787096276.205031:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452608:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.205140:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452736:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.205207:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.205240:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a87ed4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787096276.205304:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084452736 00000100:00100000:0.0:1787096276.205311:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084452736 00000100:00100000:0.0:1787096276.205350:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787096276.205455:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787096276.205555:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452736:12345-0@lo:1000:mdt00_001.0 Request processed in 107us (348us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787096276.205567:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787096276.205624:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452736:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.205692:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452864:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.205728:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.205757:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a87ed4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787096276.205776:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084452864 00000100:00100000:0.0:1787096276.205784:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084452864 00000100:00100000:0.0:1787096276.205816:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787096276.205822:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787096276.205892:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452864:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096276.205898:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787096276.205952:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452864:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.206032:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452992:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.206075:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.206115:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a87ed4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096276.206221:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084452992 00000100:00100000:3.0:1787096276.206232:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084452992 00000100:00100000:3.0:1787096276.206300:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787096276.206310:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787096276.206459:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084452992:12345-0@lo:1000:mdt00_001.0 Request processed in 149us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.206471:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787096276.206515:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084452992:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.206604:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084453120:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096276.206637:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.206665:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7a87ed4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787096276.206685:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084453120 00000100:00100000:2.0:1787096276.206695:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084453120 00000100:00100000:2.0:1787096276.206749:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787096276.206759:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084453120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787096276.206842:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6477:x1873906084453120:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.206849:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787096276.206910:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084453120:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1787096276.207257:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096276.207328:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1787096276.207337:0:6477:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c79831d7000 with version 2 00000004:00080000:3.0:1787096276.207421:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 2 rpc_version 2 00000040:00080000:1.0:1787096276.207486:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096276.207512:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].2, 64 off32896 00000004:00080000:1.0:1787096276.207519:0:6477:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c79831d7300 with version 3 00000020:00100000:3.0:1787096276.207563:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096276.207586:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7a883f7100 x1873906084453376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096276.207617:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084453376:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096276.207695:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.207736:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096276.207757:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084453376 00000100:00100000:0.0:1787096276.207767:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084453376 00000100:00100000:0.0:1787096276.207848:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787096276.207868:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7405:x1873906084453376:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1787096276.208561:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096276.209017:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1787096276.209201:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].1, 2152 off34920 00000040:00080000:1.0:1787096276.209291:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].1, 2352 off35120 00000004:00080000:1.0:1787096276.209295:0:6477:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c7a87ed43c0 with version 4 00000001:00080000:3.0:1787096276.211875:0:6456:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000100:00100000:0.0:1787096276.212046:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7405:x1873906084453376:12345-0@lo:1000:osp_up0-1.0 Request processed in 4181us (4350us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787096276.212057:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000004:00080000:3.0:1787096276.212085:0:7405:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967356 committed transno 4294967356 00000100:00100000:3.0:1787096276.212089:0:7405:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967356 gen 2 00000100:00100000:3.0:1787096276.212103:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084453376:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787096276.212137:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 3 rpc_version 3 00000020:00100000:3.0:1787096276.212160:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096276.212165:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7a883f7100 x1873906084453632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096276.212177:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084453632:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096276.212205:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.212230:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787096276.212265:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084453632 00000100:00100000:0.0:1787096276.212271:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084453632 00000100:00100000:0.0:1787096276.212302:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787096276.212308:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:7405:x1873906084453632:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787096276.214973:0:6456:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000100:00100000:0.0:1787096276.215093:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:7405:x1873906084453632:12345-0@lo:1000:osp_up0-1.0 Request processed in 2779us (2882us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787096276.215106:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000004:00080000:3.0:1787096276.215131:0:7405:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967357 committed transno 4294967357 00000100:00100000:3.0:1787096276.215138:0:7405:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967357 gen 2 00000100:00100000:3.0:1787096276.215155:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084453632:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787096276.215172:0:7405:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c7aad23da80 version 4 rpc_version 4 00000020:00100000:3.0:1787096276.215208:0:7405:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096276.215213:0:7405:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c7a883f7100 x1873906084453888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096276.215235:0:7405:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084453888:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096276.215264:0:7405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.215321:0:7405:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7aa07c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096276.215334:0:7407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084453888 00000100:00100000:1.0:1787096276.215341:0:7407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084453888 00000100:00100000:1.0:1787096276.215415:0:7407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787096276.215426:0:7407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7405:x1873906084453888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096276.216527:0:7407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7405:x1873906084453888:12345-0@lo:1000:osp_up0-1.0 Request processed in 1099us (1257us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1787096276.216564:0:7407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787096276.216634:0:7405:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7405:1873906084453888:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787096276.216728:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.216738:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.216747:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.216759:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.216764:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.216769:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.216808:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.216816:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.216843:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096276.216862:0:6477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084454016:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787096276.216897:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.216940:0:6477:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787096276.216977:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084454016 00000100:00100000:2.0:1787096276.216988:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084454016 00000100:00100000:2.0:1787096276.217042:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787096276.217051:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6477:x1873906084454016:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787096276.217066:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096276.217082:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d6a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9eebb2eb7f50d699 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.217114:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d699 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.217125:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d699 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.217133:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c7a86975200) 00010000:00010000:2.0:1787096276.217136:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096276.217138:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7aa2751c00, rc 0) 00000100:00100000:2.0:1787096276.217198:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6477:x1873906084454016:12345-0@lo:101:mdt00_001.0 Request processed in 148us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.217205:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787096276.217245:0:6477:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6477:1873906084454016:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096276.217256:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217263:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096276.217277:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000081f554aa reply state 00000000b90cf05a transno 4294967299 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217285:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d692 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217290:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff8c7a8b27a700) 00010000:00010000:1.0:1787096276.217293:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096276.217295:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096276.217299:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217305:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096276.217310:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x2:0x0] 00000004:00010000:1.0:1787096276.217320:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000081f554aa reply state 00000000b90cf05a transno 4294967299 ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217326:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881a00/0x9eebb2eb7f50d68b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217330:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8c7a8b27af00) 00010000:00010000:1.0:1787096276.217332:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096276.217333:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787096276.217336:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00080000:1.0:1787096276.217340:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787096276.217345:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217349:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217373:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217392:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787096276.217395:0:6477:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787096276.217400:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.217405:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.217442:0:6466:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096276.217453:0:6466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.217467:0:6466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c8c00 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096276.217475:0:6466:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096276.217486:0:6466:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.217524:0:6466:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096276.217529:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:33715:x1873906077055104:12345-192.168.201.52@tcp:36:lfs.0 Request processed in 24075us (24196us total) trans 4294967299 rc 0/0 00010000:00010000:0.0:1787096276.217561:0:6466:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787096276.217603:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 146 00010000:00010000:0.0:1787096276.217619:0:6466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.217644:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7a869c8c00/0x9eebb2eb7f50d66f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x9eebb2eb7f50d676 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096276.217666:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084454144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096276.217686:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096276.217689:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096276.217693:0:6466:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096276.217719:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.217806:0:7401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084454144 00000100:00100000:3.0:1787096276.217812:0:7401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084454144 00000100:00100000:3.0:1787096276.217866:0:7401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787096276.217880:0:7401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983920a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3629:x1873906084454144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096276.217899:0:7401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096276.217924:0:7401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d676 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x9eebb2eb7f50d66f expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.217946:0:7401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a86975a00) 00010000:00010000:3.0:1787096276.217958:0:7401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096276.218047:0:7401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983920a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3629:x1873906084454144:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.218052:0:7401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787096276.218143:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084454144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096276.230877:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096276.230973:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077055360 00000100:00100000:2.0:1787096276.230984:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077055360 00000100:00100000:2.0:1787096276.231054:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:2.0:1787096276.231068:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+5:33718:x1873906077055360:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096276.231088:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096276.231114:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751400/0x9eebb2eb7f50d6a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b4109e expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.231190:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750000/0x9eebb2eb7f50d6ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.231207:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750000/0x9eebb2eb7f50d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.231221:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750000/0x9eebb2eb7f50d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096276.231267:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096276.231273:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096276.231299:0:6476:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750000/0x9eebb2eb7f50d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.231328:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751400/0x9eebb2eb7f50d6a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4109e expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.231350:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750000/0x9eebb2eb7f50d6ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b4109e expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.231435:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a86975c00) 00010000:00010000:2.0:1787096276.231440:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096276.231447:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7aa2750000, rc 0) 00000100:00100000:2.0:1787096276.231511:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+6:33718:x1873906077055360:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 445us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.231523:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 147 00000100:00100000:3.0:1787096276.232646:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.232707:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077055488 00000100:00100000:1.0:1787096276.232713:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077055488 00000100:00100000:1.0:1787096276.232750:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:1.0:1787096276.232757:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+6:33718:x1873906077055488:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096276.232769:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096276.232797:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d6b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b410a5 expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.232839:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.232849:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.232857:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.232866:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.232873:0:10275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d684 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d67d expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.232880:0:10275:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.232898:0:10275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d684 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x9eebb2eb7f50d67d expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096276.232922:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10275:1873906084454272:0@lo:104: 00000100:00100000:1.0:1787096276.232952:0:10275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.232989:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1787096276.233009:0:6460:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084454272 00000100:00100000:3.0:1787096276.233014:0:6460:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084454272 00000100:00100000:3.0:1787096276.233062:0:6460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787096276.233068:0:6460:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10275:x1873906084454272:12345-0@lo:104: 00010000:00010000:3.0:1787096276.233078:0:6460:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.233122:0:6460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787096276.233127:0:6460:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:10275:x1873906084454272:12345-0@lo:104: Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.233133:0:6460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787096276.233168:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10275:1873906084454272:0@lo:104: 00010000:00010000:0.0:1787096276.233171:0:6465:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096276.233181:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.233184:0:10275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.233218:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881800 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096276.233225:0:6465:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096276.233234:0:6465:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.233265:0:6465:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.233272:0:6465:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096276.233302:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.233311:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983881800/0x9eebb2eb7f50d67d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d684 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096276.233329:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084454400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096276.233351:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096276.233395:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096276.233401:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096276.233415:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096276.233450:0:10225:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084454400 00000100:00100000:0.0:1787096276.233457:0:10225:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084454400 00010000:00010000:0.0:1787096276.233493:0:10225:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d684 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x9eebb2eb7f50d67d expref: 8 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096276.233524:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787096276.233534:0:10225:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3626:x1873906084454400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096276.233579:0:10225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787096276.235231:0:6456:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967358 is committed 00010000:00010000:0.0:1787096276.235317:0:10225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d684 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x9eebb2eb7f50d67d expref: 7 pid: 7980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.235330:0:10225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff8c7a92c71700) 00010000:00010000:0.0:1787096276.235334:0:10225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.235343:0:10225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.235348:0:10225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.235401:0:10225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096276.235441:0:10275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235453:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096276.235459:0:10225:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3626:x1873906084454400:12345-0@lo:103:ldlm_bl.0 Request processed in 1923us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.235488:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084454400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096276.235489:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787096276.235579:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10275:1873906084454528:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096276.235614:0:10275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.235636:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787096276.235662:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084454528 00000100:00100000:0.0:1787096276.235668:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084454528 00000100:00100000:0.0:1787096276.235704:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787096276.235718:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a87946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10275:x1873906084454528:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787096276.235809:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a87946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10275:x1873906084454528:12345-0@lo:1000:mdt00_004.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096276.235822:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787096276.235842:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10275:1873906084454528:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787096276.235896:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880800/0x9eebb2eb7f50d6ca lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235908:0:10275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880800/0x9eebb2eb7f50d6ca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235918:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880800/0x9eebb2eb7f50d6ca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096276.235938:0:10275:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880800/0x9eebb2eb7f50d6ca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235964:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235972:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235978:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235982:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096276.235985:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235990:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.235998:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a86975c00) 00010000:00010000:1.0:1787096276.236000:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096276.236003:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236008:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d6bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236017:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236022:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236026:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236036:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096276.236038:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236043:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236048:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff8c7a92c71700) 00010000:00010000:1.0:1787096276.236050:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096276.236058:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236062:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d6c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236086:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d6b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410a5 expref: 8 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236095:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880800/0x9eebb2eb7f50d6ca lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410a5 expref: 7 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.236101:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8c7a8b27a000) 00010000:00010000:1.0:1787096276.236102:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096276.236104:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880800, rc 0) 00000100:00100000:1.0:1787096276.236139:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+7:33718:x1873906077055488:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 3383us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.236145:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 148 00000100:00100000:3.0:1787096276.237163:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096276.237237:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077055616 00000100:00100000:2.0:1787096276.237246:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077055616 00000100:00100000:2.0:1787096276.237300:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:2.0:1787096276.237315:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:33718:x1873906077055616:12345-192.168.201.52@tcp:900:lfs.0 00000100:00100000:2.0:1787096276.237437:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:33718:x1873906077055616:12345-192.168.201.52@tcp:900:lfs.0 Request processed in 123us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.237449:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 7 00000100:00100000:0.0:1787096276.238239:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.238282:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077055744 00000100:00100000:1.0:1787096276.238294:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077055744 00000100:00100000:1.0:1787096276.238327:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:1.0:1787096276.238334:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:33718:x1873906077055744:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096276.238345:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096276.238386:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d6d1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b410ac expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.238416:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50d6d8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.238425:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50d6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.238432:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50d6d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096276.238480:0:6477:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096276.238484:0:6477:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096276.238502:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881200/0x9eebb2eb7f50d6d1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410ac expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.238513:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7983881c00/0x9eebb2eb7f50d6d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410ac expref: 8 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.238519:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8c7a8b27af00) 00010000:00010000:1.0:1787096276.238520:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1787096276.238522:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881c00, rc 0) 00000100:00100000:1.0:1787096276.238573:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:33718:x1873906077055744:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 240us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.238579:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 149 00000100:00100000:0.0:1787096276.239672:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096276.239748:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077055872 00000100:00100000:2.0:1787096276.239757:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077055872 00000100:00100000:2.0:1787096276.239809:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:2.0:1787096276.239824:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+8:33718:x1873906077055872:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096276.239840:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096276.239859:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2751400/0x9eebb2eb7f50d6df lrc: 2/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b410b3 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.239903:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d6e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.239918:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d6e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.239942:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d6e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096276.239984:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1787096276.239989:0:6476:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096276.240024:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2751400/0x9eebb2eb7f50d6df lrc: 0/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410b3 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.240044:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c7aa2750200/0x9eebb2eb7f50d6e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410b3 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.240056:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff8c7a8b27a700) 00010000:00010000:2.0:1787096276.240060:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096276.240064:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7aa2750200, rc 0) 00000100:00100000:2.0:1787096276.240117:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+9:33718:x1873906077055872:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 295us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.240127:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 150 00000100:00100000:3.0:1787096276.241150:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.241195:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077056000 00000100:00100000:1.0:1787096276.241201:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077056000 00000100:00100000:1.0:1787096276.241242:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:1.0:1787096276.241249:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+7:33718:x1873906077056000:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096276.241258:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096276.241266:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d6ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b410ba expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.241294:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.241303:0:10275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d6a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x9eebb2eb7f50d699 expref: 5 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.241309:0:10275:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.241325:0:10275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x9eebb2eb7f50d699 expref: 5 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096276.241332:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10275:1873906084454656:0@lo:104: 00000100:00100000:1.0:1787096276.241389:0:10275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.241422:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1787096276.241457:0:7399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084454656 00000100:00100000:3.0:1787096276.241465:0:7399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084454656 00000100:00100000:3.0:1787096276.241511:0:7399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787096276.241523:0:7399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10275:x1873906084454656:12345-0@lo:104: 00010000:00010000:3.0:1787096276.241550:0:7399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.241617:0:7399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787096276.241626:0:7399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:10275:x1873906084454656:12345-0@lo:104: Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.241629:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983386680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10275:1873906084454656:0@lo:104: 00010000:00010000:0.0:1787096276.241643:0:8374:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787096276.241645:0:7399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1787096276.241650:0:10275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.241654:0:8374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.241670:0:8374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880000 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096276.241676:0:8374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096276.241684:0:8374:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.241713:0:8374:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.241718:0:8374:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096276.241743:0:8374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.241752:0:8374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c7983880000/0x9eebb2eb7f50d699 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x9eebb2eb7f50d6a0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096276.241762:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084454784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096276.241800:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096276.241803:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096276.241808:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096276.241816:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.241861:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084454784 00000100:00100000:3.0:1787096276.241866:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084454784 00010000:00010000:3.0:1787096276.241883:0:6463:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d6a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x9eebb2eb7f50d699 expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096276.241907:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787096276.241913:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3627:x1873906084454784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096276.241922:0:6463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096276.242244:0:6463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d6a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x9eebb2eb7f50d699 expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.242255:0:6463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c7a86975200) 00010000:00010000:3.0:1787096276.242266:0:6463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.242272:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.242277:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096276.242296:0:6463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096276.242320:0:10275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.242328:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096276.242332:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084454784:12345-0@lo:103:ldlm_bl.0 Request processed in 417us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.242341:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00200000:1.0:1787096276.242392:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1787096276.242397:0:10275:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096276.242422:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881e00/0x9eebb2eb7f50d6ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410ba expref: 9 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.242437:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410ba expref: 8 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096276.242444:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084454784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096276.242455:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c7a86975200) 00010000:00010000:1.0:1787096276.242458:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096276.242461:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880a00, rc 0) 00000100:00100000:1.0:1787096276.242496:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+8:33718:x1873906077056000:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1247us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.242506:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 151 00000100:00100000:0.0:1787096276.243580:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.243619:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077056128 00000100:00100000:1.0:1787096276.243625:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077056128 00000100:00100000:1.0:1787096276.243654:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:1.0:1787096276.243662:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:33718:x1873906077056128:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096276.243679:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096276.243690:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d6fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b410c1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243717:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243730:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243736:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243747:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243752:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243757:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243781:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243786:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243790:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243795:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243799:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096276.243802:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243806:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243818:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c7a86975200) 00010000:00010000:1.0:1787096276.243820:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096276.243823:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243828:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880200/0x9eebb2eb7f50d702 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243836:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243840:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243845:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243849:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096276.243852:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243856:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243860:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7b711ae6 (ffff8c7a8b27ae00) 00010000:00010000:1.0:1787096276.243862:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096276.243863:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243867:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243893:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d6fb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c1 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243902:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c7a86975200) 00010000:00010000:1.0:1787096276.243905:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096276.243909:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d6fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c1 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.243919:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881400, rc 0) 00000100:00100000:1.0:1787096276.243962:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:33718:x1873906077056128:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 299us (383us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096276.243970:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00100000:0.0:1787096276.245330:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096276.245434:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077056384 00000100:00100000:2.0:1787096276.245443:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077056384 00000100:00100000:2.0:1787096276.245493:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:2.0:1787096276.245508:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c79838ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+8:33718:x1873906077056384:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:2.0:1787096276.245523:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096276.245527:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787096276.245566:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880a00/0x9eebb2eb7f50d6f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410ba expref: 8 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.245587:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c7a86975200) 00010000:00010000:2.0:1787096276.245609:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096276.245624:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751400/0x9eebb2eb7f50d710 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b410c8 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.245722:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.245737:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.245749:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.245768:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750400/0x9eebb2eb7f50d71e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.245779:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750400/0x9eebb2eb7f50d71e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.245790:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750400/0x9eebb2eb7f50d71e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246276:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246290:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246302:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096276.246315:0:6476:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 0 00010000:00010000:2.0:1787096276.246350:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246399:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246410:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246420:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7aa2750a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096276.246427:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246439:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246452:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c7a836ec800) 00010000:00010000:2.0:1787096276.246457:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096276.246462:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246472:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750a00/0x9eebb2eb7f50d717 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096276.246488:0:6476:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bc4939c8 reply state 00000000291fc831 transno 4294967359 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750400/0x9eebb2eb7f50d71e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246504:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2750400/0x9eebb2eb7f50d71e lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246514:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x7b711ae6 (ffff8c7a836ece00) 00010000:00010000:2.0:1787096276.246518:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096276.246522:0:6476:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787096276.246577:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751400/0x9eebb2eb7f50d710 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246611:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096276.246623:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8c7a836ec100) 00010000:00010000:2.0:1787096276.246627:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096276.246631:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a89767000, rc 0) 00000100:00100000:2.0:1787096276.246686:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c79838ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9858421-28a9-4744-99eb-72e5bedc52c4+10:33718:x1873906077056384:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1181us (1356us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1787096276.246698:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 153 00000100:00100000:3.0:1787096276.248121:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.248167:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077056640 00000100:00100000:1.0:1787096276.248174:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077056640 00000100:00100000:1.0:1787096276.248211:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:1.0:1787096276.248218:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+10:33718:x1873906077056640:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:1.0:1787096276.248233:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096276.248245:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d733 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b410cf expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.248309:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.248319:0:10275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.248325:0:10275:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.248352:0:10275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.248397:0:10275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 11 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096276.248408:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10275:1873906084454912:192.168.201.52@tcp:104: 00000100:00100000:1.0:1787096276.248457:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c79831d7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096276.249375:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10275:1873906084454912:192.168.201.52@tcp:104: 00010000:00010000:1.0:1787096276.249393:0:10275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096276.249703:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.249761:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077056768 00000100:00100000:1.0:1787096276.249767:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077056768 00010000:00010000:1.0:1787096276.249789:0:8375:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 12 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096276.249832:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 56 00000100:00100000:1.0:1787096276.249842:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+12:2406:x1873906077056768:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096276.249852:0:8375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096276.249857:0:8375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 12 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.249869:0:8375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 12 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.249893:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410c8 expref: 12 pid: 6476 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.249903:0:8375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8c7a836ec100) 00010000:00010000:1.0:1787096276.249907:0:8375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.249912:0:8375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.249917:0:8375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096276.249936:0:8375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096276.249970:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+11:2406:x1873906077056768:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 129us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.249978:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 56 00010000:00010000:0.0:1787096276.249983:0:10275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.249994:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096276.250014:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 0 00010000:00010000:0.0:1787096276.250142:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250151:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250157:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250162:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096276.250167:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250177:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250195:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8c7a836ec100) 00010000:00010000:0.0:1787096276.250209:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787096276.250215:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250225:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880400/0x9eebb2eb7f50d73a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250268:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d733 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410cf expref: 10 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250283:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8c7a836ec100) 00010000:00010000:0.0:1787096276.250287:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787096276.250293:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881400/0x9eebb2eb7f50d733 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b410cf expref: 10 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096276.250312:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983881400, rc 0) 00000100:00100000:0.0:1787096276.250405:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+9:33718:x1873906077056640:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 2184us (2283us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096276.250413:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 154 00000100:00100000:3.0:1787096276.251432:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.251482:0:14257:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077057024 00000100:00100000:1.0:1787096276.251488:0:14257:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077057024 00000100:00100000:1.0:1787096276.251525:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1787096276.251533:0:14257:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+9:33718:x1873906077057024:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1787096276.251698:0:14257:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+10:33718:x1873906077057024:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 165us (274us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787096276.251705:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 21 00000100:00100000:1.0:1787096276.464657:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084455296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096276.464676:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a883f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084455168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096276.464730:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36cee2c3-5860-4e4f-81d9-386cc3395e70:3626:1873906084455424:0@lo:400:kworker.0 00000100:00100000:1.0:1787096276.464758:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.464786:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084455552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096276.464843:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096276.464880:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.464906:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906084455680:0@lo:400:kworker.0 00000100:00100000:3.0:1787096276.464912:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084455296 00000100:00100000:3.0:1787096276.464921:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084455296 00000100:00100000:0.0:1787096276.464945:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084455040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096276.464953:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1873906084455936:0@lo:400:kworker.0 00000100:00100000:1.0:1787096276.464958:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.464993:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084455168 00000100:00100000:0.0:1787096276.464999:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.465000:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084455168 00000100:00100000:1.0:1787096276.465001:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1873906084456192:0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.465018:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.465039:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084455040 00000100:00100000:3.0:1787096276.465045:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084455040 00000100:00100000:0.0:1787096276.465051:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1873906084455808:0@lo:400:kworker.0 00000100:00100000:1.0:1787096276.465059:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096276.465066:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084456448:0@lo:400:kworker.0 00000100:00100000:3.0:1787096276.465075:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787096276.465087:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084455296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096276.465119:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7983909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084456704:0@lo:400:kworker.0 00002000:00000024:3.0:1787096276.465124:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096276.465134:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096276.465141:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096276.465200:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787096276.465212:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084456320:0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.465218:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084456576:0@lo:400:kworker.0 00000100:00100000:1.0:1787096276.465220:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.465230:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084455296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.465259:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787096276.465299:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1787096276.465299:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a879f1500 x1873906084455296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096276.465307:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096276.465314:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084455424 00000100:00100000:3.0:1787096276.465319:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084455168:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096276.465324:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084455424 00000100:00100000:1.0:1787096276.465330:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084455296:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787096276.465345:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096276.465451:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787096276.465457:0:9462:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084456448 00000100:00100000:1.0:1787096276.465461:0:8358:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084456704 00000100:00100000:0.0:1787096276.465467:0:9462:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084456448 00000100:00100000:2.0:1787096276.465470:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3626:x1873906084455424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096276.465473:0:8358:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084456704 00000100:00100000:3.0:1787096276.465490:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1873906084455168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.465502:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787096276.465558:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3626:x1873906084455424:12345-0@lo:400:kworker.0 Request processed in 96us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.465576:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787096276.465582:0:8358:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084456320 00000100:00100000:3.0:1787096276.465585:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787096276.465587:0:8358:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084456320 00000100:00100000:0.0:1787096276.465596:0:9462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787096276.465597:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3629:x1873906084455040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096276.465616:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096276.465617:0:9462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084456704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096276.465661:0:8358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787096276.465676:0:8358:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3626:x1873906084456448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.465687:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096276.465711:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3629:x1873906084455040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.465721:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787096276.465749:0:9462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084456704:12345-0@lo:400:kworker.0 Request processed in 136us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.465766:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:36cee2c3-5860-4e4f-81d9-386cc3395e70:3626:1873906084455424:0@lo:400:kworker.0 00000100:00100000:0.0:1787096276.465774:0:9462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787096276.465777:0:9453:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084456576 00000100:00100000:1.0:1787096276.465777:0:8358:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906084456448:12345-0@lo:400:kworker.0 Request processed in 96us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.465792:0:9453:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084456576 00000100:00100000:1.0:1787096276.465798:0:8358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787096276.465850:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1873906084456448:0@lo:400:kworker.0 00000100:00100000:0.0:1787096276.465862:0:9462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787096276.465873:0:9453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787096276.465883:0:9462:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084456320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.465889:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084455680 00000100:00100000:3.0:1787096276.465891:0:9453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084456576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.465896:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084455680 00000100:00100000:1.0:1787096276.465929:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084456704:0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.465959:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084455936 00000100:00100000:2.0:1787096276.465964:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084455936 00000100:00100000:0.0:1787096276.465979:0:9462:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084456320:12345-0@lo:400:kworker.0 Request processed in 102us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.465981:0:9453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084456576:12345-0@lo:400:kworker.0 Request processed in 95us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.465985:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084456192 00000100:00100000:1.0:1787096276.465993:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084456192 00000100:00100000:2.0:1787096276.465994:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084455808 00000100:00100000:3.0:1787096276.466000:0:9453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787096276.466001:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084455808 00000100:00100000:0.0:1787096276.466017:0:9462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787096276.466048:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1787096276.466051:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787096276.466058:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787096276.466065:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787096276.466069:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906084455680:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787096276.466070:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096276.466081:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787096276.466090:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787096276.466101:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1873906084455936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096276.466102:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a879f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1873906084456192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096276.466105:0:10275:0:(service.c:3465:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:3.0:1787096276.466126:0:10275:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1787096276.466139:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906084455680:12345-0@lo:400:kworker.0 Request processed in 78us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.466147:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00080000:3.0:1787096276.466182:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abd5c0a80 x1873906084456576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096276.466193:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a879f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1873906084456192:12345-0@lo:400:kworker.0 Request processed in 91us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.466198:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084456576:0@lo:400:kworker.0 00000100:00100000:0.0:1787096276.466204:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787096276.466221:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906084455680:0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.466230:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1873906084455936:12345-0@lo:400:kworker.0 Request processed in 133us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096276.466238:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1873906084455936:0@lo:400:kworker.0 00000100:00100000:0.0:1787096276.466242:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787096276.466252:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1873906084456192:0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.466261:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787096276.466262:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1873906084455808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096276.466298:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096276.466313:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1873906084455808:12345-0@lo:400:kworker.0 Request processed in 61us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096276.466320:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787096276.466346:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906084456064:0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.466410:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1873906084455808:0@lo:400:kworker.0 00010000:00080000:2.0:1787096276.466435:0:3629:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7abd60c700 x1873906084456320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096276.466449:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084455552 00000100:00100000:3.0:1787096276.466457:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.466460:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084455552 00000100:00100000:2.0:1787096276.466467:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084456320:0@lo:400:kworker.0 00000100:00100000:2.0:1787096276.466524:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a883f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084455168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096276.466591:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084455040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096276.466593:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787096276.466594:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084456064 00000100:00100000:0.0:1787096276.466614:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084456064 00000100:00100000:1.0:1787096276.466622:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a883f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084455552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787096276.466643:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787096276.466664:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096276.466710:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787096276.466715:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a883f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084455552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.466726:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787096276.466748:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906084456064:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787096276.466781:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7983921c00 x1873906084455552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096276.466799:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7983921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084455552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096276.466824:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906084456064:0@lo:400:kworker.0 00000100:00100000:0.0:1787096276.466829:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906084456064:12345-0@lo:400:kworker.0 Request processed in 104us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096276.466863:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787096276.570114:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:2.0:1787096276.570163:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096276.570179:0:6469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077057152 00000100:00100000:1.0:1787096276.570190:0:6469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077057152 00000100:00100000:1.0:1787096276.570244:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 296 00000100:00100000:0.0:1787096276.570244:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077057280 00000100:00100000:0.0:1787096276.570254:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077057280 00000100:00100000:1.0:1787096276.570259:0:6469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2406:x1873906077057152:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1787096276.570309:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 197 00000100:00100000:0.0:1787096276.570318:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7983921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+9:2406:x1873906077057280:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1787096276.570337:0:6469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88500c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5469a594-d695-447b-b0fa-7bef4580840e+9:2406:x1873906077057152:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.570343:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 296 00000100:00100000:0.0:1787096276.570384:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7983921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+9:2406:x1873906077057280:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096276.570391:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 197 00010000:00010000:0.0:1787096276.656475:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096276.743948:0:21764:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_23a: @@@@@@ FAIL: setstripe failed 00000100:00100000:0.0:1787096276.976547:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084456832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787096276.976623:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096276.976679:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084456832 00000100:00100000:1.0:1787096276.976688:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084456832 00000100:00100000:1.0:1787096276.976747:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787096276.976762:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aadf2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084456832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787096276.976797:0:7980:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446375424 avail 1300135936 00000100:00100000:1.0:1787096276.976855:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aadf2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1873906084456832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096276.976864:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787096276.976901:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a879f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1873906084456832:0@lo:41:osp-pre-1-0.0 Debug log: 1966 lines, 1966 kept, 0 dropped, 0 bad.