00010000:00010000:1.0F:1787096550.673570:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1787096550.920818:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0F:1787096550.920886:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345491456 00000100:00100000:3.0:1787096550.920903:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345491456 00000100:00100000:3.0:1787096550.921022:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 140 00000100:00100000:3.0:1787096550.921035:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187552b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+8:28008:x1873906345491456:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:3.0:1787096550.921059:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096550.921101:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1f7d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.921171:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166bbd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.921185:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166bbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.921196:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166bbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096550.921237:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096550.921240:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:0.0:1787096550.921333:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1787096550.921374:0:9989:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166bbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.921413:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f7d expref: 10 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.921430:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166bbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f7d expref: 9 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.921505:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96184a9eaf00) 00010000:00010000:3.0:1787096550.921509:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096550.921513:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840030000, rc 0) 00000100:00100000:3.0:1787096550.921587:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187552b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+9:28008:x1873906345491456:12345-192.168.201.40@tcp:101:rm.0 Request processed in 556us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096550.921595:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 140 00000100:00100000:1.0:1787096550.927250:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0F:1787096550.927286:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345491584 00000100:00100000:2.0:1787096550.927300:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345491584 00000100:00100000:2.0:1787096550.927345:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 141 00000100:00100000:2.0:1787096550.927352:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+9:28008:x1873906345491584:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096550.927369:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096550.927401:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a800/0xa979d75fc166bbdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1f84 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.927859:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.927874:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.927886:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.927897:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.927911:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.927918:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928018:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166bbf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928027:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166bbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928035:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166bbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096550.928078:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 0 00000004:00200000:2.0:1787096550.928082:0:6489:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096550.928100:0:6489:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166bbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928111:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166bbf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928120:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928127:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928134:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928141:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096550.928144:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928152:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928164:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96184a9eaf00) 00010000:00010000:2.0:1787096550.928167:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096550.928172:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928179:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bbe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928200:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928207:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928213:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928219:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096550.928222:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928228:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928236:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff96184a9eab00) 00010000:00010000:2.0:1787096550.928238:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096550.928241:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928247:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b800/0xa979d75fc166bbe9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928270:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a800/0xa979d75fc166bbdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f84 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928282:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166bbf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f84 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096550.928300:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff961742a27000) 00010000:00010000:2.0:1787096550.928302:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096550.928305:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4ae00, rc 0) 00000100:00100000:2.0:1787096550.928362:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+10:28008:x1873906345491584:12345-192.168.201.40@tcp:101:rm.0 Request processed in 1010us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096550.928370:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 141 00000100:00100000:2.0:1787096550.930699:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096550.930746:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345491840 00000100:00100000:3.0:1787096550.930754:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345491840 00000100:00100000:3.0:1787096550.930794:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 142 00000100:00100000:3.0:1787096550.930801:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+10:28008:x1873906345491840:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:3.0:1787096550.930849:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787096550.930867:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166bbf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f84 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.930879:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff961742a27000) 00010000:00010000:3.0:1787096550.930890:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030000/0xa979d75fc166bbd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f7d expref: 9 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.930902:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96184a9eaf00) 00010000:00010000:3.0:1787096550.930906:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096550.930922:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.930931:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.930937:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.930944:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.930950:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.930963:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931032:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931038:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931042:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931291:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931298:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931305:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931312:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931318:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931324:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931345:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787096550.931362:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096550.931366:0:7858:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096550.931374:0:7858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931399:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931406:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096550.931407:0:7858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030400 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:0.0:1787096550.931412:0:7858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931416:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096550.931423:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096550.931423:0:7858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096550.931459:0:7858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff96184a9ea000) 00010000:00010000:0.0:1787096550.931462:0:7858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787096550.931465:0:7858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096550.931469:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030400/0xa979d75fc166bc0c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096550.931478:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096550.931480:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096550.931482:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096550.931625:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931638:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff96184a9ea000) 00010000:00010000:3.0:1787096550.931641:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096550.931645:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931650:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc05 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931668:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931675:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931681:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931686:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096550.931701:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931708:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931717:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:3.0:1787096550.931719:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096550.931722:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931727:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030800/0xa979d75fc166bbf7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096550.931736:0:6490:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f23c71c6 reply state 00000000c9638c7d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931743:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096550.931748:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff96184a9eab00) 00010000:00010000:3.0:1787096550.931749:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096550.931751:0:6490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787096550.931814:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+10:28008:x1873906345491840:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1011us (1121us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787096550.931821:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 142 00000100:00100000:3.0:1787096551.502716:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787096551.502739:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353949056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096551.502757:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353949184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096551.502813:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096551.502899:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353949056 00000100:00100000:0.0:1787096551.502907:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353949056 00000100:00100000:1.0:1787096551.502912:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096551.502946:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353949312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096551.502963:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353949184 00000100:00100000:1.0:1787096551.502968:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353949184 00000100:00100000:0.0:1787096551.502973:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787096551.502980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096551.502987:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961877977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353949056:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096551.503005:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787096551.503013:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353949184:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1787096551.503020:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096551.503031:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353949312 00000100:00100000:3.0:1787096551.503036:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353949312 00000004:00000024:1.0:1787096551.503037:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787096551.503069:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787096551.503079:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353949312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787096551.503092:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096551.503094:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961877977100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353949056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096551.503100:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353949184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096551.503114:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787096551.503116:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787096551.503133:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353949312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096551.503141:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1787096551.503148:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787096551.503184:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f9aa00 x1873906353949312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096551.503184:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353949184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096551.503202:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353949312:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787096551.503241:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96187bbbca80 x1873906353949056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096551.503254:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353949056:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787096551.692114:0:19905:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 19:42:30 (1787096550) 00010000:00010000:0.0:1787096551.697203:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096552.461406:0:19953:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_10 needs >= 5 OSTs 00010000:00010000:3.0:1787096552.718574:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096553.320885:0:20002:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 11: can create --ec 2+2 ================ 19:42:32 (1787096552) 00010000:00010000:1.0:1787096553.745923:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096553.759863:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096553.759910:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096553.759929:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345492096 00000100:00100000:1.0:1787096553.759938:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096553.759940:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345492096 00000100:00100000:0.0:1787096553.759971:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345491968 00000100:00100000:0.0:1787096553.759977:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345491968 00000100:00100000:2.0:1787096553.759985:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345492224 00000100:00100000:2.0:1787096553.759991:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345492224 00000100:00080000:1.0:1787096553.760013:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787096553.760019:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096553.760032:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 314 00000100:00100000:2.0:1787096553.760045:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 232 00000100:00100000:3.0:1787096553.760055:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 233 00000100:00100000:0.0:1787096553.760057:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618485c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d421c913-8ded-4ece-9979-167ed163b87c+9:2402:x1873906345491968:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:2.0:1787096553.760058:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+10:2403:x1873906345492096:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096553.760070:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:2402:x1873906345492224:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096553.760139:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:2402:x1873906345492224:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096553.760140:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+10:2403:x1873906345492096:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096553.760141:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618485c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d421c913-8ded-4ece-9979-167ed163b87c+9:2402:x1873906345491968:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096553.760157:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 232 00000100:00100000:3.0:1787096553.760166:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 233 00000100:00100000:0.0:1787096553.760168:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 314 00000001:02000400:0.0:1787096554.001433:0:20050:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_11 needs >= 4 OSTs 00000100:00100000:3.0:1787096554.062609:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353949568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096554.062623:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353949440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096554.062685:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096554.062729:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353949568 00000100:00100000:2.0:1787096554.062738:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353949568 00000100:00100000:3.0:1787096554.062797:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096554.062804:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787096554.062817:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d33b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353949568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787096554.062847:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787096554.062853:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096554.062900:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d33b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353949568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096554.062908:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787096554.062923:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353949440 00000100:00100000:2.0:1787096554.062926:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353949440 00000100:00100000:0.0:1787096554.063384:0:17665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787096554.063395:0:17665:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353949440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787096554.063409:0:17665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096554.063434:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353949568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096554.063483:0:17665:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353949440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096554.063491:0:17665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787096554.063524:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bbbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353949440:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787096554.063530:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096554.063605:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef59912-d6a3-4393-bae9-348c8f3519b6:3636:1873906353949696:0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.063609:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1873906353949824:0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.063657:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096554.063663:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096554.063692:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353949824 00000100:00100000:2.0:1787096554.063696:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353949824 00000100:00100000:3.0:1787096554.063705:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1873906353950336:0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.063713:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1873906353950208:0@lo:400:kworker.0 00000100:00100000:2.0:1787096554.063726:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787096554.063733:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1873906353949824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.063740:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096554.063756:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353949696 00000100:00100000:0.0:1787096554.063762:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353949696 00000100:00100000:3.0:1787096554.063773:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1873906353950848:0@lo:400:kworker.0 00000100:00100000:2.0:1787096554.063787:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1873906353949824:12345-0@lo:400:kworker.0 Request processed in 53us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096554.063797:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787096554.063797:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787096554.063807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096554.063811:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618485c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3636:x1873906353949696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096554.063827:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353950336 00000100:00100000:2.0:1787096554.063832:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353950336 00000100:00100000:3.0:1787096554.063841:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1873906353949824:0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.063855:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618485c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3636:x1873906353949696:12345-0@lo:400:kworker.0 Request processed in 47us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096554.063867:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787096554.063875:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353950848 00000100:00100000:3.0:1787096554.063880:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353950848 00000100:00100000:2.0:1787096554.063885:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787096554.063894:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1873906353950336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.063911:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787096554.063919:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1873906353950848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.063936:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096554.063942:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1873906353950336:12345-0@lo:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096554.063950:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787096554.063962:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1873906353950848:12345-0@lo:400:kworker.0 Request processed in 44us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096554.063965:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353950208 00000100:00100000:0.0:1787096554.063965:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353950720:0@lo:400:kworker.0 00000100:00100000:2.0:1787096554.063971:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353950208 00000100:00100000:3.0:1787096554.063974:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787096554.064006:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096554.064010:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787096554.064019:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1873906353950208:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787096554.064029:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787096554.064033:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096554.064041:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef59912-d6a3-4393-bae9-348c8f3519b6:3636:1873906353949696:0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064058:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1873906353950208:12345-0@lo:400:kworker.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096554.064066:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1873906353950208:0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064067:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787096554.064091:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353950720 00000100:00100000:0.0:1787096554.064095:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353950720 00000100:00100000:3.0:1787096554.064104:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353949952:0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064133:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096554.064152:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787096554.064159:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353950464:0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.064162:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353950720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096554.064207:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353950720:12345-0@lo:400:kworker.0 Request processed in 47us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096554.064216:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787096554.064229:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353950464 00000100:00100000:0.0:1787096554.064233:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353950464 00000100:00100000:3.0:1787096554.064237:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1873906353950976:0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.064258:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787096554.064264:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096554.064269:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353950464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064289:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787096554.064297:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1873906353950080:0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.064305:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353950464:12345-0@lo:400:kworker.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096554.064312:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1787096554.064314:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096554.064327:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096554.064355:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353950976 00000100:00100000:0.0:1787096554.064359:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353950976 00000100:00100000:3.0:1787096554.064363:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353950592:0@lo:400:kworker.0 00000100:00100000:2.0:1787096554.064363:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353950080 00000100:00100000:2.0:1787096554.064368:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353950080 00000100:00100000:3.0:1787096554.064396:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096554.064400:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787096554.064406:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787096554.064410:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1873906353950976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096554.064417:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1873906353950080:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787096554.064432:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f9a680 x1873906353950464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096554.064519:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1873906353950976:12345-0@lo:400:kworker.0 Request processed in 110us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096554.064523:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1873906353950080:12345-0@lo:400:kworker.0 Request processed in 108us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096554.064538:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787096554.064545:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:0.0:1787096554.064568:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787096554.064598:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f99f80 x1873906353950720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096554.064615:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353950720:0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064616:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353950464:0@lo:400:kworker.0 00010000:00080000:3.0:1787096554.064642:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f9bb80 x1873906353950976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096554.064651:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1873906353950976:0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064670:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1873906353950080:0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064689:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353949952 00000100:00100000:3.0:1787096554.064692:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353949952 00000100:00100000:3.0:1787096554.064722:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353950592 00000100:00100000:3.0:1787096554.064725:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353950592 00000100:00100000:3.0:1787096554.064748:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787096554.064759:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353949952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.064759:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787096554.064774:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353950592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096554.064836:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353950592:12345-0@lo:400:kworker.0 Request processed in 66us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096554.064841:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353949952:12345-0@lo:400:kworker.0 Request processed in 83us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096554.064847:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787096554.064855:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787096554.064870:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353950592:0@lo:400:kworker.0 00000100:00100000:2.0:1787096554.064884:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353949952:0@lo:400:kworker.0 00010000:00080000:3.0:1787096554.064955:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f99880 x1873906353950336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096554.064964:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1873906353950336:0@lo:400:kworker.0 00000100:00100000:3.0:1787096554.064974:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1873906353950848:0@lo:400:kworker.0 00000100:00100000:2.0:1787096554.574685:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353951104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787096554.574748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096554.575052:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353951104 00000100:00100000:0.0:1787096554.575058:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353951104 00000100:00100000:0.0:1787096554.575097:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787096554.575104:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353951104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787096554.575131:0:6493:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787096554.575244:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353951104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096554.575250:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787096554.575301:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353951104:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1787096554.576186:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00010000:00010000:3.0:1787096554.576233:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166bbaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576247:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166bbaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576254:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166bbaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576260:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618821e4200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096554.576264:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166bbaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576271:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166bbaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576286:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff96184a9eab00) 00010000:00010000:3.0:1787096554.576290:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096554.576294:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166bbaa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576300:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166bbaa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576321:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576339:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576345:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576350:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961840030e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096554.576353:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576359:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576367:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff96184a9eab00) 00010000:00010000:3.0:1787096554.576369:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096554.576372:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096554.576377:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bbfe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1787096554.718902:0:20098:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a 00010000:00010000:1.0:1787096554.767359:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096555.572023:0:20146:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12b skipping ALWAYS excluded test 12b 00010000:00010000:0.0:1787096555.790671:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096556.336705:0:20194:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12c: resync a file using both FLR and EC (without overstriping) ========================================================== 19:42:35 (1787096555) 00000100:00100000:0.0:1787096556.622649:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353951232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787096556.622720:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096556.622788:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353951232 00000100:00100000:1.0:1787096556.622796:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353951232 00000100:00100000:1.0:1787096556.622847:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787096556.622859:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353951232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787096556.622893:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787096556.622944:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353951232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096556.622963:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787096556.622990:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353951232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787096556.625557:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787096556.625573:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353951360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096556.625629:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096556.625671:0:8453:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353951360 00000100:00100000:3.0:1787096556.625679:0:8453:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353951360 00000100:00100000:2.0:1787096556.625908:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787096556.625920:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353951488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096556.625953:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096556.626027:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353951488 00000100:00100000:1.0:1787096556.626032:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353951488 00000100:00080000:0.0:1787096556.627659:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096556.627867:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787096556.627879:0:8453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353951360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787096556.627911:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096556.628010:0:8453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353951360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096556.628028:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787096556.628053:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787096556.628063:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353951488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787096556.628075:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787096556.628075:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96187c810e00 x1873906353951360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096556.628100:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353951360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096556.628126:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353951488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (2171us total) trans 0 rc 0/0 00010000:00080000:2.0:1787096556.628142:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f98a80 x1873906353951488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096556.628158:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353951488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096556.632577:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00010000:3.0:1787096556.814864:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096557.076860:0:20243:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12c needs >= 8 OSTs 00010000:00010000:1.0:1787096557.838591:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096557.914218:0:20291:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12d: resync a file using both FLR and EC (with overstriping) ========================================================== 19:42:36 (1787096556) 00000001:02000400:0.0:1787096558.594869:0:20339:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12d needs >= 8 OSTs 00010000:00010000:1.0:1787096558.865362:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096558.879284:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096558.879372:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096558.879404:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096558.879607:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345492608 00000100:00100000:1.0:1787096558.879620:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345492608 00000100:00100000:3.0:1787096558.879716:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345492480 00000100:00100000:3.0:1787096558.879722:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345492480 00000100:00100000:1.0:1787096558.879742:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 240 00000100:00100000:1.0:1787096558.879758:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345492608:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096558.879867:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345492608:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 111us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096558.879875:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 240 00000100:00080000:0.0:1787096558.880220:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787096558.880225:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096558.882398:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345492352 00000100:00100000:2.0:1787096558.882413:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345492352 00000100:00100000:0.0:1787096558.882619:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 316 00000100:00100000:0.0:1787096558.882633:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618485c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2401:x1873906345492352:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1787096558.882817:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618485c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2401:x1873906345492352:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 187us (3542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096558.882826:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 316 00000100:00100000:3.0:1787096558.883093:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 241 00000100:00100000:3.0:1787096558.883104:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345492480:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096558.883138:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345492480:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 39us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096558.883144:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 241 00000100:00100000:3.0:1787096559.182575:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787096559.182601:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353951616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096559.182627:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353951744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096559.182968:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.183179:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353952128:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.183212:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.183234:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353952640:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.183277:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.183296:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1873906353953152:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.183325:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.183352:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787096559.183359:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906353952000:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.183382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.183407:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906353952512:0@lo:400:kworker.0 00000100:00100000:3.0:1787096559.183434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.183435:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.183827:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906353953024:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.183873:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.183915:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353952128 00000100:00100000:2.0:1787096559.183924:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353952128 00000100:00100000:2.0:1787096559.183980:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787096559.183991:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186e0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353952128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184056:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186e0f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353952128:12345-0@lo:400:kworker.0 Request processed in 67us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.184064:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787096559.184091:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353952640 00000100:00100000:2.0:1787096559.184095:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353952640 00000100:00100000:2.0:1787096559.184135:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787096559.184141:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186e0fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353952640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184246:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186e0fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353952640:12345-0@lo:400:kworker.0 Request processed in 105us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.184264:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787096559.184284:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353953152 00000100:00100000:2.0:1787096559.184289:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353953152 00000100:00100000:2.0:1787096559.184316:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353952000 00000100:00100000:2.0:1787096559.184319:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353952000 00000100:00100000:2.0:1787096559.184331:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353952512 00000100:00100000:2.0:1787096559.184333:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353952512 00000100:00100000:2.0:1787096559.184351:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353953024 00000100:00100000:2.0:1787096559.184354:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353953024 00000100:00100000:2.0:1787096559.184371:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787096559.184377:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1873906353953152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184419:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1873906353953152:12345-0@lo:400:kworker.0 Request processed in 43us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.184433:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787096559.184472:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787096559.184478:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906353952000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184572:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906353952000:12345-0@lo:400:kworker.0 Request processed in 94us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.184579:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787096559.184597:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787096559.184602:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906353952512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184634:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906353952512:12345-0@lo:400:kworker.0 Request processed in 32us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.184640:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787096559.184650:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787096559.184656:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906353953024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184682:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906353953024:12345-0@lo:400:kworker.0 Request processed in 27us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.184688:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787096559.184749:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef59912-d6a3-4393-bae9-348c8f3519b6:3637:1873906353951872:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184842:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.184872:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1873906353952384:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.184912:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353952896:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.184961:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787096559.184968:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1873906353952256:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.184989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.185003:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353952768:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.185025:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.185040:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186e0f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353953280:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.185057:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.185081:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353952768 00000100:00100000:2.0:1787096559.185085:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353952768 00000100:00100000:2.0:1787096559.185109:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787096559.186720:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353952768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.186917:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353952768:12345-0@lo:400:kworker.0 Request processed in 1798us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.186927:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787096559.186974:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353952384 00000100:00100000:2.0:1787096559.186982:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353952384 00000100:00100000:2.0:1787096559.187027:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353952256 00000100:00100000:2.0:1787096559.187030:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353952256 00000100:00100000:2.0:1787096559.187051:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787096559.187060:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1873906353952384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.187094:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1873906353952384:12345-0@lo:400:kworker.0 Request processed in 36us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.187100:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787096559.187111:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787096559.187117:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1873906353952256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.187144:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1873906353952256:12345-0@lo:400:kworker.0 Request processed in 27us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.187160:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1787096559.187187:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787096559.187193:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787096559.187197:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096559.187249:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1873906353952256:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.187277:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353952768:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.187289:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1873906353952384:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.187342:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906353952000:0@lo:400:kworker.0 00010000:00080000:2.0:1787096559.187360:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f9ad80 x1873906353952512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096559.187372:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906353952512:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.187386:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906353953024:0@lo:400:kworker.0 00000100:00100000:2.0:1787096559.187400:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353952128:0@lo:400:kworker.0 00010000:00080000:2.0:1787096559.187413:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f98380 x1873906353952640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096559.187421:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353952640:0@lo:400:kworker.0 00010000:00080000:2.0:1787096559.187433:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f9b480 x1873906353953152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096559.187459:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1873906353953152:0@lo:400:kworker.0 00000100:00100000:3.0:1787096559.187693:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353951744 00000100:00100000:3.0:1787096559.187699:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353951744 00000100:00100000:3.0:1787096559.187758:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353951616 00000100:00100000:3.0:1787096559.187762:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353951616 00000100:00100000:3.0:1787096559.187790:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787096559.187799:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353951744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096559.187830:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096559.187865:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787096559.187875:0:8453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353951616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096559.187884:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353951744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (4914us total) trans 0 rc 0/0 00002000:00000024:2.0:1787096559.187893:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096559.187895:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787096559.187928:0:8453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353951616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (4496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.187934:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1787096559.187951:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096559.187981:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353951744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096559.187989:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353951616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096559.188096:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353951872 00000100:00100000:0.0:1787096559.188102:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353951872 00000100:00100000:0.0:1787096559.188170:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787096559.188179:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618485c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3637:x1873906353951872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096559.188222:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618485c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3637:x1873906353951872:12345-0@lo:400:kworker.0 Request processed in 45us (3380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096559.188228:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787096559.188314:0:8456:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353952896 00000100:00100000:0.0:1787096559.188319:0:8456:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353952896 00000100:00100000:3.0:1787096559.188347:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef59912-d6a3-4393-bae9-348c8f3519b6:3637:1873906353951872:0@lo:400:kworker.0 00000100:00100000:0.0:1787096559.188403:0:8456:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353953280 00000100:00100000:0.0:1787096559.188406:0:8456:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353953280 00000100:00100000:0.0:1787096559.188430:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787096559.188460:0:8456:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353952896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096559.188470:0:8364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787096559.188488:0:8364:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353953280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096559.188513:0:8456:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353952896:12345-0@lo:400:kworker.0 Request processed in 65us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096559.188521:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787096559.188536:0:8364:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353953280:12345-0@lo:400:kworker.0 Request processed in 51us (3476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096559.188545:0:8364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787096559.188560:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186e0f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353953280:0@lo:400:kworker.0 00010000:00080000:0.0:1787096559.188576:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f9aa00 x1873906353952896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096559.188585:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353952896:0@lo:400:kworker.0 00000100:00080000:2.0:1787096559.189969:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787096559.405093:0:20387:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 19:42:38 (1787096558) 00000100:00100000:1.0:1787096559.695715:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787096559.695746:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353953408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096559.695839:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096559.695893:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353953408 00000100:00100000:2.0:1787096559.695905:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353953408 00000100:00100000:2.0:1787096559.695970:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787096559.695980:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353953408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096559.696020:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787096559.696092:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353953408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096559.696107:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787096559.696140:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353953408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787096559.886612:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096560.283361:0:20435:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_13 needs >= 4 OSTs 00010000:00010000:3.0:1787096560.911585:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096561.066164:0:20483:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 19:42:39 (1787096559) 00000100:00100000:2.0:1787096561.742594:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353953792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787096561.742594:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353953664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096561.746683:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096561.746761:0:17665:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353953664 00000100:00100000:3.0:1787096561.746774:0:17665:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353953664 00000100:00100000:0.0:1787096561.746788:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353953536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096561.746853:0:17665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787096561.746860:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096561.746869:0:17665:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353953664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787096561.746912:0:17665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096561.746964:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353953536 00000100:00100000:0.0:1787096561.746969:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353953536 00000100:00100000:3.0:1787096561.746978:0:17665:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353953664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096561.746987:0:17665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787096561.747006:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787096561.747015:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353953536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096561.747026:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096561.747064:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353953536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096561.747081:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1787096561.747122:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787096561.747128:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961850196d80 x1873906353953664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096561.747152:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353953664:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787096561.747166:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742db0e00 x1873906353953536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096561.747179:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353953536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096561.751433:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096561.752897:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353953792 00000100:00100000:3.0:1787096561.752910:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353953792 00000100:00100000:3.0:1787096561.753062:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787096561.753078:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353953792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787096561.753125:0:6493:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787096561.753201:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353953792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096561.753224:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787096561.753569:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353953792:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787096561.822671:0:20531:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_20 needs >= 4 OSTs 00010000:00010000:0.0:1787096561.934635:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096562.700365:0:20579:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22: test that lfs mirror read from ec does not change eof ========================================================== 19:42:41 (1787096561) 00010000:00010000:1.0:1787096562.959129:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096563.413820:0:20627:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22 needs >= 8 OSTs 00010000:00010000:1.0:1787096563.982893:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096564.002564:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096564.002607:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096564.002639:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096564.002669:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345492992 00000100:00100000:0.0:1787096564.002678:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345492992 00000100:00100000:0.0:1787096564.002735:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345492864 00000100:00100000:0.0:1787096564.002738:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345492864 00000100:00100000:0.0:1787096564.002761:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 248 00000100:00100000:0.0:1787096564.002771:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:2403:x1873906345492992:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1787096564.002844:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:2403:x1873906345492992:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096564.002854:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 248 00000100:00100000:0.0:1787096564.002871:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 249 00000100:00100000:0.0:1787096564.002879:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:2403:x1873906345492864:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1787096564.002936:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:2403:x1873906345492864:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096564.002945:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 249 00000100:00080000:0.0:1787096564.002970:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787096564.002975:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096564.003169:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345492736 00000100:00100000:2.0:1787096564.003187:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345492736 00000100:00100000:2.0:1787096564.003230:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 318 00000100:00100000:2.0:1787096564.003239:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618485c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2403:x1873906345492736:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:2.0:1787096564.003284:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618485c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2403:x1873906345492736:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 46us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096564.003302:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 318 00000001:02000400:0.0:1787096564.247259:0:20676:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28b: test that lfs mirror verify for ec does not change eof ========================================================== 19:42:43 (1787096563) 00000100:00100000:3.0:1787096564.302762:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787096564.302796:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353953920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096564.302889:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096564.302968:0:17665:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353953920 00000100:00100000:3.0:1787096564.302978:0:17665:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353953920 00000100:00100000:3.0:1787096564.303043:0:17665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787096564.303055:0:17665:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353953920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096564.303094:0:17665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096564.303142:0:17665:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353953920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096564.303150:0:17665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1787096564.303190:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096564.303235:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353953920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096564.303345:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787096564.303357:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353954048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096564.303393:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096564.303427:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353954048 00000100:00100000:1.0:1787096564.303432:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353954048 00000100:00100000:1.0:1787096564.303487:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787096564.303495:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353954048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787096564.303506:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096564.303540:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353954048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096564.303546:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1787096564.303565:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787096564.303584:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353954048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096564.304153:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906353954304:0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.304256:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096564.304280:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906353954816:0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.304302:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096564.304322:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906353955328:0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.304357:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096564.304378:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787096564.304383:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef59912-d6a3-4393-bae9-348c8f3519b6:3635:1873906353954176:0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.304410:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096564.304429:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1873906353954688:0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.304471:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096564.304521:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353955200:0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.304576:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096564.304635:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353954304 00000100:00100000:0.0:1787096564.304649:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353954304 00000100:00100000:0.0:1787096564.304697:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353954816 00000100:00100000:0.0:1787096564.304700:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353954816 00000100:00100000:0.0:1787096564.304751:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353955328 00000100:00100000:0.0:1787096564.304772:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353955328 00000100:00100000:0.0:1787096564.304821:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353954688 00000100:00100000:0.0:1787096564.304824:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353954688 00000100:00100000:0.0:1787096564.304848:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787096564.304856:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186e0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906353954304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.304933:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186e0f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906353954304:12345-0@lo:400:kworker.0 Request processed in 77us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096564.304939:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787096564.304970:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787096564.304990:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906353954816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.305030:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906353954816:12345-0@lo:400:kworker.0 Request processed in 42us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096564.305037:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787096564.305048:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787096564.305054:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906353955328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.305079:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906353955328:12345-0@lo:400:kworker.0 Request processed in 25us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096564.305102:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787096564.305125:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787096564.305132:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1873906353954688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.305199:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1873906353954688:12345-0@lo:400:kworker.0 Request processed in 68us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096564.305206:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787096564.305253:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353954176 00000100:00100000:0.0:1787096564.305257:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353954176 00000100:00100000:0.0:1787096564.305315:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787096564.305335:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618485c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3635:x1873906353954176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.305407:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618485c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3635:x1873906353954176:12345-0@lo:400:kworker.0 Request processed in 74us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096564.305430:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787096564.305533:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353955200 00000100:00100000:0.0:1787096564.305537:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353955200 00000100:00100000:0.0:1787096564.305602:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787096564.305612:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353955200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096564.305685:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353955200:12345-0@lo:400:kworker.0 Request processed in 63us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096564.305693:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787096564.305887:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1873906353954560:0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.305919:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096564.305940:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353955072:0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.305964:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096564.305982:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787096564.305989:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353954432:0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.306008:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096564.306024:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353954944:0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.306042:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096564.306059:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1873906353955456:0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.306078:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096564.306100:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353955072 00000100:00100000:3.0:1787096564.306103:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353955072 00000100:00100000:3.0:1787096564.306129:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353954432 00000100:00100000:3.0:1787096564.306131:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353954432 00000100:00100000:3.0:1787096564.306147:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787096564.306154:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353955072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.306213:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353955072:12345-0@lo:400:kworker.0 Request processed in 59us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096564.306221:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787096564.306236:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787096564.306242:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353954432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.306267:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353954432:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096564.306273:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787096564.306297:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353954944 00000100:00100000:3.0:1787096564.306300:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353954944 00000100:00080000:1.0:1787096564.306402:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787096564.306409:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787096564.306411:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787096564.306585:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787096564.306593:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353954944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.306625:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353954944:12345-0@lo:400:kworker.0 Request processed in 33us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096564.306631:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787096564.306655:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353954560 00000100:00100000:3.0:1787096564.306659:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353954560 00000100:00100000:3.0:1787096564.306686:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353955456 00000100:00100000:3.0:1787096564.306689:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353955456 00000100:00100000:3.0:1787096564.306826:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787096564.306833:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1873906353954560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.306866:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1873906353954560:12345-0@lo:400:kworker.0 Request processed in 34us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096564.306873:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787096564.306885:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787096564.306891:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1873906353955456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.306929:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1873906353955456:12345-0@lo:400:kworker.0 Request processed in 39us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096564.306935:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787096564.306970:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353954432:0@lo:400:kworker.0 00010000:00080000:3.0:1787096564.306984:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961850197480 x1873906353954944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096564.306995:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353954944:0@lo:400:kworker.0 00010000:00080000:3.0:1787096564.307005:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961850194380 x1873906353955456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096564.307013:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1873906353955456:0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.307021:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1873906353954560:0@lo:400:kworker.0 00000100:00100000:3.0:1787096564.307029:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353955072:0@lo:400:kworker.0 00000100:00080000:1.0:1787096564.307116:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096564.307135:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef59912-d6a3-4393-bae9-348c8f3519b6:3635:1873906353954176:0@lo:400:kworker.0 00000100:00100000:1.0:1787096564.307149:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1873906353954688:0@lo:400:kworker.0 00010000:00080000:1.0:1787096564.307162:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961850195500 x1873906353955200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096564.307182:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353955200:0@lo:400:kworker.0 00000100:00100000:1.0:1787096564.307195:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906353954304:0@lo:400:kworker.0 00010000:00080000:1.0:1787096564.307205:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961850196300 x1873906353954816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096564.307221:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906353954816:0@lo:400:kworker.0 00000100:00100000:1.0:1787096564.307234:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906353955328:0@lo:400:kworker.0 00000100:00100000:1.0:1787096564.815545:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787096564.815569:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353955584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096564.815638:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096564.815684:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353955584 00000100:00100000:3.0:1787096564.815694:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353955584 00000100:00100000:3.0:1787096564.815750:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787096564.815761:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353955584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787096564.815806:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787096564.815868:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353955584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096564.815874:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787096564.815994:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353955584:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787096564.904935:0:20724:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28b needs >= 8 OSTs 00010000:00010000:3.0:1787096565.006580:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096565.669316:0:20772:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28c: test that reading past parity data returns zeros ========================================================== 19:42:44 (1787096564) 00010000:00010000:0.0:1787096566.030789:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096566.341171:0:20820:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28c needs >= 8 OSTs 00000100:00100000:1.0:1787096566.862627:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353955712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787096566.862725:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096566.862769:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353955712 00000100:00100000:3.0:1787096566.862780:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353955712 00000100:00100000:3.0:1787096566.862848:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787096566.862860:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353955712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787096566.862906:0:6493:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787096566.862970:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353955712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096566.862978:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787096566.863009:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353955712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787096566.863535:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787096566.863545:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353955840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096566.863582:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096566.863668:0:17665:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353955840 00000100:00100000:3.0:1787096566.863674:0:17665:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353955840 00000100:00080000:1.0:1787096566.863722:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096566.863727:0:17665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787096566.863738:0:17665:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353955840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787096566.863762:0:17665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096566.863811:0:17665:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353955840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096566.863817:0:17665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:1.0:1787096566.863861:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96186d2c7b80 x1873906353955840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096566.863878:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353955840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096566.863984:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353955968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096566.864012:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096566.864050:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353955968 00000100:00100000:2.0:1787096566.864056:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353955968 00000100:00080000:1.0:1787096566.864086:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096566.864102:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787096566.864111:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353955968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096566.864133:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096566.864176:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353955968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096566.864183:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:1.0:1787096566.864208:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742db1500 x1873906353955968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096566.864223:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353955968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787096567.054559:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096567.057410:0:20868:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 19:42:46 (1787096566) 00000001:02000400:3.0:1787096567.740050:0:20916:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31b needs >= 8 OSTs 00010000:00010000:1.0:1787096568.078631:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096568.513166:0:20964:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 19:42:47 (1787096567) 00000001:02000400:3.0:1787096569.087366:0:21012:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31c needs >= 8 OSTs 00010000:00010000:0.0:1787096569.102809:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096569.118579:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096569.118640:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096569.118652:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345493248 00000100:00100000:1.0:1787096569.118667:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345493248 00000100:00100000:0.0:1787096569.118676:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096569.118706:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345493376 00000100:00100000:0.0:1787096569.118712:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345493376 00000100:00100000:1.0:1787096569.118753:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 256 00000100:00100000:1.0:1787096569.118773:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2403:x1873906345493248:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:2.0:1787096569.118827:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345493120 00000100:00100000:2.0:1787096569.118833:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345493120 00000100:00100000:1.0:1787096569.118875:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2403:x1873906345493248:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096569.118888:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 320 00000100:00100000:2.0:1787096569.118897:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96185022c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d421c913-8ded-4ece-9979-167ed163b87c+9:2402:x1873906345493120:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:2.0:1787096569.118930:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96185022c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d421c913-8ded-4ece-9979-167ed163b87c+9:2402:x1873906345493120:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 35us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096569.118938:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 320 00000100:00100000:0.0:1787096569.118950:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 257 00000100:00100000:1.0:1787096569.118959:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 256 00000100:00100000:0.0:1787096569.118965:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+5:2402:x1873906345493376:12345-192.168.201.40@tcp:400:kworker.0 00000100:00080000:1.0:1787096569.118988:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787096569.118993:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096569.119005:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+5:2402:x1873906345493376:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096569.119012:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 257 00000100:00100000:1.0:1787096569.422841:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787096569.422869:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353956096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096569.422883:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787096569.422897:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353956224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096569.422963:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096569.422993:0:17665:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353956096 00000100:00100000:3.0:1787096569.423003:0:17665:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353956096 00000100:00100000:3.0:1787096569.423105:0:17665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787096569.423109:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096569.423117:0:17665:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353956096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096569.423154:0:17665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096569.423216:0:17665:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353956096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.423233:0:17665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787096569.423264:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353956096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096569.423272:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096569.423321:0:8453:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353956224 00000100:00100000:0.0:1787096569.423326:0:8453:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353956224 00000100:00080000:1.0:1787096569.423374:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096569.423374:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787096569.423390:0:8453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353956224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787096569.423403:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096569.423479:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353956224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096569.423486:0:8453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353956224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096569.423496:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787096569.426227:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787096569.426250:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1873906353956736:0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.426272:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353956608:0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.426316:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1873906353956480:0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.426337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096569.426340:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096569.426383:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353957120:0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.426386:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1873906353956864:0@lo:400:kworker.0 00000100:00100000:0.0:1787096569.426400:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef59912-d6a3-4393-bae9-348c8f3519b6:3634:1873906353956352:0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.426411:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096569.426412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096569.426434:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353957376:0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.426435:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1873906353957632:0@lo:400:kworker.0 00000100:00100000:0.0:1787096569.426463:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096569.426484:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096569.426487:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096569.426508:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353957248:0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.426525:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353956608 00000100:00100000:1.0:1787096569.426525:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353956736 00000100:00100000:3.0:1787096569.426533:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353956608 00000100:00100000:1.0:1787096569.426533:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353956736 00000100:00100000:0.0:1787096569.426540:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096569.426578:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353956864 00000100:00100000:1.0:1787096569.426581:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353956864 00000100:00100000:3.0:1787096569.426583:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353957248 00000100:00100000:0.0:1787096569.426584:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353957632 00000100:00100000:3.0:1787096569.426586:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353957248 00000100:00100000:0.0:1787096569.426590:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353957632 00000100:00100000:3.0:1787096569.426608:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787096569.426625:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353956608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.426625:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787096569.426630:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1873906353956736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096569.426642:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787096569.426651:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1873906353956864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.426683:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353956608:12345-0@lo:400:kworker.0 Request processed in 60us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096569.426683:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1873906353956736:12345-0@lo:400:kworker.0 Request processed in 51us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.426691:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787096569.426691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787096569.426709:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1873906353956864:12345-0@lo:400:kworker.0 Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096569.426714:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787096569.426717:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787096569.426721:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787096569.426725:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353957248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.426725:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1873906353957632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096569.426751:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353956352 00000100:00100000:3.0:1787096569.426763:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353957248:12345-0@lo:400:kworker.0 Request processed in 40us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096569.426763:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1873906353957632:12345-0@lo:400:kworker.0 Request processed in 41us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.426770:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787096569.426770:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787096569.426776:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353956352 00000100:00100000:3.0:1787096569.426791:0:8364:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353957120 00000100:00100000:3.0:1787096569.426796:0:8364:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353957120 00000100:00080000:1.0:1787096569.426800:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787096569.426805:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096569.426814:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787096569.426820:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096569.426829:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96185022e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3634:x1873906353956352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.426841:0:8364:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353957376 00000100:00100000:1.0:1787096569.426841:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1873906353956992:0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.426844:0:8364:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353957376 00000100:00100000:3.0:1787096569.426867:0:8364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787096569.426872:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096569.426877:0:8364:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353957120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096569.426877:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96185022e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3634:x1873906353956352:12345-0@lo:400:kworker.0 Request processed in 49us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096569.426889:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1873906353957504:0@lo:400:kworker.0 00000100:00100000:0.0:1787096569.426895:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787096569.426911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096569.426914:0:8364:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353957120:12345-0@lo:400:kworker.0 Request processed in 41us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.426922:0:8364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787096569.426933:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353956480 00000100:00100000:3.0:1787096569.426934:0:8364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787096569.426936:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353956480 00000100:00100000:3.0:1787096569.426939:0:8364:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353957376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.426956:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353956992 00000100:00100000:1.0:1787096569.426959:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353956992 00000100:00100000:3.0:1787096569.426972:0:8364:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353957376:12345-0@lo:400:kworker.0 Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.426977:0:8364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787096569.426978:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353957504 00000100:00100000:1.0:1787096569.426981:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353957504 00000100:00100000:1.0:1787096569.427000:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00080000:3.0:1787096569.427006:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096569.427007:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1873906353956864:0@lo:400:kworker.0 00000100:00080000:3.0:1787096569.427008:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096569.427008:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1873906353956480:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787096569.427012:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787096569.427033:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742c8d880 x1873906353957376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787096569.427037:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742c8f100 x1873906353957120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096569.427048:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1873906353956480:12345-0@lo:400:kworker.0 Request processed in 41us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096569.427058:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353957376:0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.427062:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353957120:0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.427068:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:3.0:1787096569.427075:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742c8f800 x1873906353957632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096569.427097:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1873906353957632:0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.427097:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787096569.427104:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1873906353956992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096569.427109:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353956608:0@lo:400:kworker.0 00000100:00100000:0.0:1787096569.427118:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787096569.427130:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1873906353957504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.427136:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1873906353956992:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096569.427142:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787096569.427166:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353957248:0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.427170:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1873906353956480:0@lo:400:kworker.0 00000100:00100000:0.0:1787096569.427176:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1873906353957504:12345-0@lo:400:kworker.0 Request processed in 47us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.427179:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1873906353956736:0@lo:400:kworker.0 00010000:00080000:1.0:1787096569.427182:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742c8c000 x1873906353956992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096569.427194:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787096569.427195:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef59912-d6a3-4393-bae9-348c8f3519b6:3634:1873906353956352:0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.427195:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1873906353956992:0@lo:400:kworker.0 00000100:00100000:1.0:1787096569.427211:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1873906353957504:0@lo:400:kworker.0 00000001:02000400:3.0:1787096569.713028:0:21060:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31d: test that size of parity mirror is 1*2*64k ========================================================== 19:42:48 (1787096568) 00000100:00100000:0.0:1787096569.935264:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096569.935296:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353957760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787096569.935386:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096569.935800:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353957760 00000100:00100000:3.0:1787096569.935811:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353957760 00000100:00100000:3.0:1787096569.935876:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787096569.935886:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353957760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787096569.935929:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787096569.935988:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353957760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.935996:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787096569.936043:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353957760:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787096570.126554:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096570.287111:0:21108:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31d needs >= 8 OSTs 00000001:02000400:3.0:1787096570.905244:0:21156:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 30d: test that size of parity mirror is 22*64k ========================================================== 19:42:49 (1787096569) 00010000:00010000:0.0:1787096571.150859:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096571.592238:0:21205:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_30d needs >= 8 OSTs 00000100:00100000:2.0:1787096571.983773:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353957888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096571.983847:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096571.983927:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353957888 00000100:00100000:2.0:1787096571.983935:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353957888 00000100:00100000:2.0:1787096571.983988:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787096571.983997:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353957888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096571.984035:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096571.984094:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353957888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096571.984102:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1787096571.984123:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787096571.984160:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742db0380 x1873906353957888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096571.984177:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353957888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096571.986674:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787096571.986689:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353958016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096571.986738:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096571.986780:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353958016 00000100:00100000:0.0:1787096571.986785:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353958016 00000100:00100000:0.0:1787096571.986826:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787096571.986833:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353958016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787096571.986849:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096571.986887:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353958016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00080000:2.0:1787096571.986900:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096571.986906:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:0.0:1787096571.986943:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617429a3480 x1873906353958016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096571.986960:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353958016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096571.987149:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353958144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787096571.987177:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096571.987207:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353958144 00000100:00100000:0.0:1787096571.987211:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353958144 00000100:00100000:0.0:1787096571.987244:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787096571.987251:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353958144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787096571.987288:0:6493:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787096571.987332:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353958144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096571.987339:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787096571.987369:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353958144:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787096572.175621:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096572.309826:0:21253:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21a: migrate plain file to EC layout === 19:42:51 (1787096571) 00000001:02000400:1.0:1787096573.003277:0:21301:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21a needs >= 3 OSTs 00010000:00010000:0.0:1787096573.199096:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096573.808699:0:21349:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21b: migrate EC file to plain layout === 19:42:52 (1787096572) 00010000:00010000:0.0:1787096574.222660:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096574.236952:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096574.237009:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096574.237047:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096574.237071:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345493632 00000100:00100000:1.0:1787096574.237075:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345493760 00000100:00100000:3.0:1787096574.237082:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345493632 00000100:00100000:1.0:1787096574.237083:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345493760 00000100:00100000:2.0:1787096574.237104:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345493504 00000100:00100000:2.0:1787096574.237111:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345493504 00000100:00100000:2.0:1787096574.237171:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 322 00000100:00100000:1.0:1787096574.237172:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 264 00000100:00100000:3.0:1787096574.237188:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 265 00000100:00100000:2.0:1787096574.237188:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d421c913-8ded-4ece-9979-167ed163b87c+9:2400:x1873906345493504:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096574.237189:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345493760:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096574.237204:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345493632:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:3.0:1787096574.237263:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345493632:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 63us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096574.237265:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345493760:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096574.237267:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d421c913-8ded-4ece-9979-167ed163b87c+9:2400:x1873906345493504:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096574.237282:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 265 00000100:00100000:2.0:1787096574.237286:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 322 00000100:00100000:1.0:1787096574.237291:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 264 00000100:00080000:3.0:1787096574.237323:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787096574.237328:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787096574.425644:0:21397:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21b needs >= 3 OSTs 00000100:00100000:1.0:1787096574.542566:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef59912-d6a3-4393-bae9-348c8f3519b6:3635:1873906353958528:0@lo:400:kworker.0 00000100:00100000:0.0:1787096574.542583:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961743414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353958400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096574.542605:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1873906353958656:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.542665:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096574.542667:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096574.542674:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096574.542726:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353958272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096574.542733:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1873906353959040:0@lo:400:kworker.0 00000100:00100000:3.0:1787096574.542763:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353958784:0@lo:400:kworker.0 00000100:00100000:2.0:1787096574.542769:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353958656 00000100:00100000:1.0:1787096574.542771:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096574.542775:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096574.542780:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353958656 00000100:00100000:3.0:1787096574.542796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096574.542805:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353959552:0@lo:400:kworker.0 00000100:00100000:0.0:1787096574.542819:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1873906353958912:0@lo:400:kworker.0 00000100:00100000:2.0:1787096574.542830:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353959040 00000100:00100000:2.0:1787096574.542835:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353959040 00000100:00100000:1.0:1787096574.542836:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096574.542840:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353959296:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.542859:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353960064:0@lo:400:kworker.0 00000100:00100000:3.0:1787096574.542876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096574.542888:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787096574.542889:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096574.542891:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353958528 00000100:00100000:1.0:1787096574.542896:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353958528 00000100:00100000:3.0:1787096574.542898:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1873906353959808:0@lo:400:kworker.0 00000100:00100000:2.0:1787096574.542905:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1873906353958656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096574.542928:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353959424:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.542930:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787096574.542940:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096574.542940:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3635:x1873906353958528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096574.542984:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353958784 00000100:00100000:3.0:1787096574.542988:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353958784 00000100:00100000:2.0:1787096574.542989:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1873906353958656:12345-0@lo:400:kworker.0 Request processed in 90us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096574.543011:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787096574.543014:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3635:x1873906353958528:12345-0@lo:400:kworker.0 Request processed in 71us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096574.543014:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096574.543026:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787096574.543033:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353959424 00000100:00100000:3.0:1787096574.543036:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353959424 00000100:00100000:2.0:1787096574.543042:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353958912 00000100:00100000:2.0:1787096574.543046:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353958912 00000100:00100000:3.0:1787096574.543059:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787096574.543059:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353959936:0@lo:400:kworker.0 00000100:00100000:2.0:1787096574.543066:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353959808 00000100:00100000:2.0:1787096574.543070:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353959808 00000100:00100000:3.0:1787096574.543071:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353958784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543075:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787096574.543084:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1873906353959040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096574.543105:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787096574.543110:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096574.543120:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1873906353958912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096574.543121:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353958784:12345-0@lo:400:kworker.0 Request processed in 52us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096574.543121:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1873906353959040:12345-0@lo:400:kworker.0 Request processed in 35us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096574.543134:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787096574.543134:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787096574.543152:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787096574.543159:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787096574.543159:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1873906353959808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096574.543168:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353959424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096574.543181:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353958400 00000100:00100000:0.0:1787096574.543187:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353958400 00000100:00100000:2.0:1787096574.543192:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1873906353958912:12345-0@lo:400:kworker.0 Request processed in 78us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096574.543199:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787096574.543209:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353959424:12345-0@lo:400:kworker.0 Request processed in 42us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096574.543209:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1873906353959808:12345-0@lo:400:kworker.0 Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096574.543217:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787096574.543217:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:2.0:1787096574.543223:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096574.543228:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353958272 00000100:00080000:2.0:1787096574.543230:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787096574.543234:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096574.543234:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353958272 00000100:00100000:1.0:1787096574.543248:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353959552 00000100:00100000:2.0:1787096574.543250:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1873906353959168:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543252:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353959552 00000100:00100000:3.0:1787096574.543260:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353958784:0@lo:400:kworker.0 00010000:00080000:3.0:1787096574.543276:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f9aa00 x1873906353959808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096574.543281:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787096574.543290:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096574.543292:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353959296 00000100:00100000:1.0:1787096574.543297:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353959296 00000100:00100000:0.0:1787096574.543297:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353958400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096574.543308:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1873906353959808:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543325:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353959936 00002000:00000024:0.0:1787096574.543326:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096574.543328:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1873906353959680:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543329:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353959936 00000100:00100000:3.0:1787096574.543343:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353959168 00000100:00100000:3.0:1787096574.543347:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353959168 00000100:00100000:1.0:1787096574.543350:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787096574.543358:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353959552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096574.543377:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787096574.543378:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353958400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096574.543382:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096574.543389:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1873906353959168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096574.543392:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787096574.543411:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353959552:12345-0@lo:400:kworker.0 Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096574.543413:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787096574.543423:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787096574.543427:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3634:x1873906353958272:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096574.543428:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1873906353958656:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543459:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787096574.543462:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1873906353959168:12345-0@lo:400:kworker.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096574.543468:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353959296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096574.543474:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00002000:00000024:0.0:1787096574.543474:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096574.543492:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353959680 00000100:00100000:3.0:1787096574.543496:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353959680 00010000:00080000:2.0:1787096574.543500:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742db1500 x1873906353959168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096574.543513:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1873906353959168:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543515:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353959296:12345-0@lo:400:kworker.0 Request processed in 47us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096574.543523:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787096574.543524:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3634:x1873906353958272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096574.543527:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787096574.543533:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1873906353959680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096574.543539:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787096574.543545:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787096574.543553:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353959936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543582:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353959936:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096574.543585:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1873906353958912:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543594:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787096574.543604:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353959424:0@lo:400:kworker.0 00000100:00080000:3.0:1787096574.543613:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787096574.543617:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096574.543618:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353959936:0@lo:400:kworker.0 00000100:00080000:3.0:1787096574.543621:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787096574.543626:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096574.543642:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961743414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353958400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096574.543645:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1873906353959680:12345-0@lo:400:kworker.0 Request processed in 113us (274us total) trans 0 rc 0/0 00010000:00080000:1.0:1787096574.543652:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742db1c00 x1873906353959296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096574.543662:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787096574.543667:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1873906353959680:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543670:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353959296:0@lo:400:kworker.0 00000100:00100000:0.0:1787096574.543678:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353958272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096574.543694:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096574.543714:0:8365:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353960064 00000100:00100000:2.0:1787096574.543718:0:8365:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353960064 00000100:00100000:1.0:1787096574.543721:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef59912-d6a3-4393-bae9-348c8f3519b6:3635:1873906353958528:0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543739:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1873906353959040:0@lo:400:kworker.0 00000100:00100000:2.0:1787096574.543761:0:8365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00010000:00080000:1.0:1787096574.543764:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742db0e00 x1873906353959552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096574.543772:0:8365:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353960064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096574.543778:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353959552:0@lo:400:kworker.0 00000100:00100000:2.0:1787096574.543829:0:8365:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1873906353960064:12345-0@lo:400:kworker.0 Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096574.543836:0:8365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787096574.544027:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1873906353960064:0@lo:400:kworker.0 00000100:00100000:3.0:1787096575.055555:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353960192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787096575.055622:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096575.055677:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353960192 00000100:00100000:2.0:1787096575.055686:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353960192 00000100:00100000:2.0:1787096575.055737:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787096575.055749:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353960192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096575.055783:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787096575.055838:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353960192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096575.055846:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787096575.055883:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353960192:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787096575.168813:0:21445:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21c: migrate between different EC configurations ========================================================== 19:42:54 (1787096574) 00010000:00010000:0.0:1787096575.246684:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096575.732176:0:21493:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21c needs >= 4 OSTs 00010000:00010000:0.0:1787096576.272118:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096576.409683:0:21541:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21d: migrate PFL file to EC layout ===== 19:42:55 (1787096575) 00000001:02000400:2.0:1787096576.979339:0:21589:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21d needs >= 3 OSTs 00000100:00100000:2.0:1787096577.102658:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787096577.102671:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186d2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353960576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787096577.102682:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353960448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787096577.102764:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096577.102773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096577.102820:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353960576 00000100:00100000:0.0:1787096577.102831:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353960576 00000100:00100000:3.0:1787096577.102834:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353960320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096577.102839:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353960448 00000100:00100000:1.0:1787096577.102846:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353960448 00000100:00100000:3.0:1787096577.102864:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096577.102889:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787096577.102899:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353960576:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096577.102906:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353960320 00000100:00080000:2.0:1787096577.102908:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096577.102909:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353960320 00000100:00100000:1.0:1787096577.102917:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787096577.102928:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353960448:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:0.0:1787096577.102937:0:7418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787096577.102944:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787096577.102966:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353960320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787096577.102970:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1787096577.102983:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096577.103016:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353960576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096577.103023:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787096577.103033:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353960320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096577.103036:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353960448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096577.103044:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:2.0:1787096577.103056:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617429a3100 x1873906353960448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787096577.103058:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096577.103061:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787096577.103084:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353960448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096577.103106:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186d2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353960576:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1787096577.103122:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961848f99500 x1873906353960320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096577.103135:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353960320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787096577.294584:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096577.596077:0:21637:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 19:42:56 (1787096576) 00000001:02000400:0.0:1787096578.223732:0:21686:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22a needs >= 6 OSTs 00010000:00010000:0.0:1787096578.319135:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096578.936227:0:21734:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 23a: truncate EC file to smaller size == 19:42:57 (1787096577) 00000100:00100000:2.0:1787096579.005603:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096579.008163:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345493888 00000100:00100000:1.0:1787096579.008176:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345493888 00000100:00100000:1.0:1787096579.008239:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 143 00000100:00100000:1.0:1787096579.008249:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+5:33717:x1873906345493888:12345-192.168.201.40@tcp:41:stat.0 00000004:00000024:1.0:1787096579.008296:0:6489:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1787096579.010292:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+5:33717:x1873906345493888:12345-192.168.201.40@tcp:41:stat.0 Request processed in 2035us (4686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.010304:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 143 00000100:00080000:1.0:1787096579.011366:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096579.028682:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096579.028840:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345494016 00000100:00100000:1.0:1787096579.028851:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345494016 00000100:00100000:1.0:1787096579.028966:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 144 00000100:00100000:1.0:1787096579.028986:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:33721:x1873906345494016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096579.029006:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096579.029027:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166bc13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1f8b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.029089:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.029115:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.029129:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096579.029168:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096579.029171:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096579.029188:0:6488:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.029206:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166bc13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.029217:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.029233:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca000) 00010000:00010000:1.0:1787096579.029346:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096579.029350:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618429d3000, rc 0) 00000100:00100000:1.0:1787096579.029403:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+6:33721:x1873906345494016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 420us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.029408:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 144 00000100:00100000:1.0:1787096579.030604:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.030721:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345494144 00000100:00100000:2.0:1787096579.030769:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345494144 00000100:00100000:2.0:1787096579.030827:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 145 00000100:00100000:2.0:1787096579.030842:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+6:33721:x1873906345494144:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096579.030855:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096579.030866:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bc21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1f92 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.030913:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.030953:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.030963:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.030996:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031001:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031006:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031033:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031040:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031046:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031062:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4ac00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096579.031067:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031074:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031084:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca000) 00010000:00010000:2.0:1787096579.031087:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096579.031091:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031108:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031121:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031126:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031131:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031136:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4a600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096579.031138:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031143:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031160:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff961742a27b00) 00010000:00010000:2.0:1787096579.031162:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096579.031165:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031170:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031195:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bc21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f92 expref: 7 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031204:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca000) 00010000:00010000:2.0:1787096579.031206:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096579.031209:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b600/0xa979d75fc166bc21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f92 expref: 7 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.031217:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4b600, rc 0) 00000100:00100000:2.0:1787096579.031263:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+6:33721:x1873906345494144:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 421us (661us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096579.031269:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 145 00000100:00100000:3.0:1787096579.033333:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.033396:0:6497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345494272 00000100:00100000:2.0:1787096579.033406:0:6497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345494272 00000100:00100000:2.0:1787096579.033547:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 3 00000100:00100000:2.0:1787096579.033559:0:6497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:70e19547-606a-4706-b016-3476e377d7df+5:33721:x1873906345494272:12345-192.168.201.40@tcp:700:lfs.0 00000100:00100000:2.0:1787096579.033643:0:6497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:70e19547-606a-4706-b016-3476e377d7df+5:33721:x1873906345494272:12345-192.168.201.40@tcp:700:lfs.0 Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096579.033650:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 3 00000100:00080000:1.0:1787096579.033806:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787096579.035434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096579.035528:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345494528 00000100:00100000:1.0:1787096579.035538:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345494528 00000100:00100000:1.0:1787096579.035621:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 146 00000100:00100000:1.0:1787096579.035629:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+5:33721:x1873906345494528:12345-192.168.201.40@tcp:36:lfs.0 00000004:00080000:2.0:1787096579.036185:0:8109:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 516us 00000100:00100000:3.0:1787096579.042760:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:8109:1873906353960704:0@lo:900:mdt00_003.0 00000100:00100000:3.0:1787096579.042825:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.042871:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742c27d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.042893:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353960704 00000100:00100000:3.0:1787096579.042899:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353960704 00000100:00100000:3.0:1787096579.042962:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787096579.042972:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8109:x1873906353960704:12345-0@lo:900:mdt00_003.0 00000100:00100000:3.0:1787096579.043026:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8109:x1873906353960704:12345-0@lo:900:mdt00_003.0 Request processed in 56us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.043034:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787096579.043075:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:8109:1873906353960704:0@lo:900:mdt00_003.0 00000100:00100000:3.0:1787096579.043139:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353960832:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787096579.043170:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.043186:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742c27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096579.043396:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353960832 00000100:00100000:2.0:1787096579.043401:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353960832 00000100:00100000:2.0:1787096579.043504:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787096579.043512:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:8109:x1873906353960832:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096579.043573:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:8109:x1873906353960832:12345-0@lo:1000:mdt00_003.0 Request processed in 62us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096579.043579:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787096579.043701:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353960832:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096579.043891:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353960960:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096579.044043:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096579.044105:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.044224:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353960960 00000100:00100000:3.0:1787096579.044229:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353960960 00000100:00100000:3.0:1787096579.044294:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787096579.044302:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:8109:x1873906353960960:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787096579.044385:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:8109:x1873906353960960:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.044393:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787096579.044558:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353960960:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.044600:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961088:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.044628:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.044658:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787096579.044660:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353961088 00000100:00100000:2.0:1787096579.044664:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353961088 00000100:00100000:2.0:1787096579.044692:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787096579.044699:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:8109:x1873906353961088:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096579.044774:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:8109:x1873906353961088:12345-0@lo:1000:mdt00_003.0 Request processed in 76us (145us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787096579.044781:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787096579.044954:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961088:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787096579.044994:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.045002:0:8109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.045008:0:8109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096579.045024:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961216:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787096579.045042:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.045058:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.045074:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353961216 00000100:00100000:3.0:1787096579.045083:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353961216 00000100:00100000:3.0:1787096579.045144:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787096579.045151:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:8109:x1873906353961216:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787096579.045160:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096579.045174:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bc36 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.045198:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 5 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.045207:0:6493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bc36 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.045233:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 5 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.045245:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 5 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096579.045256:0:6493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db1500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6493:1873906353961344:192.168.201.40@tcp:104: 00000100:00100000:3.0:1787096579.045316:0:6493:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742c276c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096579.048121:0:6493:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db1500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6493:1873906353961344:192.168.201.40@tcp:104: 00010000:00010000:0.0:1787096579.048159:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bc36 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.048171:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca000) 00010000:00010000:0.0:1787096579.048174:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096579.048178:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bc36 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.048187:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840030e00, rc 0) 00000100:00100000:3.0:1787096579.048210:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096579.048286:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345494656 00000100:00100000:1.0:1787096579.048295:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345494656 00010000:00010000:1.0:1787096579.048340:0:6474:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 6 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096579.048379:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 55 00000100:00100000:1.0:1787096579.048388:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70e19547-606a-4706-b016-3476e377d7df+6:2401:x1873906345494656:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096579.048400:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096579.048406:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 6 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.048418:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 6 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.048437:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166bc1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f8b expref: 6 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.048474:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca000) 00010000:00010000:1.0:1787096579.048479:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bc36 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.048488:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166bc36 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.048510:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166bc36 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.048552:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bc36 expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096579.048566:0:6474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6474:1873906353961472:0@lo:105: 00000100:00100000:1.0:1787096579.049192:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096579.049207:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:8109:x1873906353961216:12345-0@lo:101:mdt00_003.0 Request processed in 4055us (4161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.049217:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787096579.049241:0:6474:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.049253:0:8379:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353961472 00000100:00100000:3.0:1787096579.049264:0:8379:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353961472 00000100:00100000:3.0:1787096579.049323:0:8379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787096579.049334:0:8379:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6474:x1873906353961472:12345-0@lo:105: 00010000:00010000:3.0:1787096579.049350:0:8379:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.049379:0:8379:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.049389:0:8379:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.049399:0:8379:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.049407:0:8379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.049420:0:8379:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.049481:0:8379:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9618429d3600) 00000100:00100000:3.0:1787096579.049544:0:8379:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6474:x1873906353961472:12345-0@lo:105: Request processed in 212us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.049551:0:8379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787096579.049624:0:6474:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6474:1873906353961472:0@lo:105: 00010000:00010000:1.0:1787096579.049639:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096579.049694:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345494656:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 1306us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.049702:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 55 00000100:00100000:2.0:1787096579.051946:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961216:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787096579.051981:0:8109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096579.052009:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096579.052057:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.052081:0:8109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.052092:0:8109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096579.052113:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961600:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787096579.052280:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.052435:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353961600 00000100:00100000:3.0:1787096579.052469:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353961600 00000100:00100000:3.0:1787096579.052557:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787096579.052573:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:8109:x1873906353961600:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787096579.052597:0:7418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096579.052623:0:7418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc4b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bc44 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.052682:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bc44 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.052698:0:7418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bc44 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.052707:0:7418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff96184a9ead00) 00010000:00010000:3.0:1787096579.052711:0:7418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096579.052715:0:7418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961840030c00, rc 0) 00000100:00100000:3.0:1787096579.052769:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353961600:12345-0@lo:101:mdt00_003.0 Request processed in 204us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.052776:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787096579.053144:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35480 going to sleep for 11 seconds 00000100:00100000:2.0:1787096579.053168:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961600:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787096579.053183:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.053195:0:8109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096579.053209:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787096579.053243:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961728:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096579.053277:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096579.053305:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096579.053383:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353961728 00000100:00100000:0.0:1787096579.053389:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353961728 00000100:00100000:0.0:1787096579.053578:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787096579.053588:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353961728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096579.053664:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353961728:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.053671:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787096579.053748:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961728:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.053781:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961856:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.053800:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.053817:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.053851:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353961856 00000100:00100000:3.0:1787096579.053856:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353961856 00000100:00100000:3.0:1787096579.053882:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787096579.053887:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353961856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787096579.053997:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353961856:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (194us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787096579.054005:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787096579.054042:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961856:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.054141:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961984:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.054167:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.054187:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787096579.054238:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353961984 00000100:00100000:0.0:1787096579.054244:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353961984 00000100:00100000:0.0:1787096579.054277:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787096579.054284:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353961984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096579.054372:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353961984:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (203us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787096579.054379:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787096579.054516:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353961984:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.054576:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353962112:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.054614:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.054643:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.054706:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353962112 00000100:00100000:3.0:1787096579.054711:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353962112 00000100:00100000:3.0:1787096579.054799:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787096579.054807:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353962112:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787096579.054867:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353962112:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.054874:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787096579.054941:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353962112:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.054979:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353962240:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.055003:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.055111:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787096579.055185:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353962240 00000100:00100000:0.0:1787096579.055190:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353962240 00000100:00100000:0.0:1787096579.055216:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787096579.055222:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186d2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353962240:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096579.055353:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186d2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353962240:12345-0@lo:1000:mdt00_003.0 Request processed in 131us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.055360:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787096579.055426:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353962240:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.055609:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353962368:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787096579.055649:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.055719:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787096579.055746:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353962368 00000100:00100000:2.0:1787096579.055751:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353962368 00000100:00100000:2.0:1787096579.055809:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787096579.055817:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353962368:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787096579.055873:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8109:x1873906353962368:12345-0@lo:1000:mdt00_003.0 Request processed in 57us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096579.055879:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787096579.055945:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353962368:0@lo:1000:mdt00_003.0 00000040:00080000:1.0:1787096579.056160:0:8109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096579.056218:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1787096579.056226:0:8109:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9618754e1000 with version 2 00000040:00080000:1.0:1787096579.056292:0:8109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096579.056303:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].2, 64 off32896 00000004:00080000:1.0:1787096579.056308:0:8109:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9618754e13c0 with version 3 00000040:00080000:1.0:1787096579.057096:0:8109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096579.057336:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1787096579.057601:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].1, 2152 off34920 00000040:00080000:1.0:1787096579.057706:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].1, 2352 off35120 00000004:00080000:1.0:1787096579.057712:0:8109:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9618754e16c0 with version 4 00000004:00080000:3.0:1787096579.057791:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 2 rpc_version 2 00000020:00100000:3.0:1787096579.057824:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096579.057833:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961742db3100 x1873906353962624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096579.057853:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353962624:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096579.057906:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.058143:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742c273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096579.058212:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353962624 00000100:00100000:0.0:1787096579.058218:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353962624 00000100:00100000:0.0:1787096579.058250:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787096579.058257:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906353962624:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787096579.061982:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000100:00100000:0.0:1787096579.062222:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906353962624:12345-0@lo:1000:osp_up0-1.0 Request processed in 3962us (4312us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787096579.062232:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:3.0:1787096579.062282:0:7416:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967356 committed transno 4294967356 00000100:00100000:3.0:1787096579.062286:0:7416:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967356 gen 2 00000100:00100000:3.0:1787096579.062299:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353962624:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787096579.062329:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 3 rpc_version 3 00000020:00100000:3.0:1787096579.062353:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096579.062361:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961742db3100 x1873906353962880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096579.062380:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353962880:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096579.062407:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.062489:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742c27000 going to sleep for 11 seconds 00000100:00100000:2.0:1787096579.062663:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353962880 00000100:00100000:2.0:1787096579.062668:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353962880 00000100:00100000:2.0:1787096579.062724:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787096579.062733:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906353962880:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787096579.070138:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000100:00100000:0.0:1787096579.070635:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906353962880:12345-0@lo:1000:osp_up0-1.0 Request processed in 7898us (8221us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787096579.070647:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000004:00080000:3.0:1787096579.070714:0:7416:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967357 committed transno 4294967357 00000100:00100000:3.0:1787096579.070719:0:7416:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967357 gen 2 00000100:00100000:3.0:1787096579.070737:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353962880:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787096579.070761:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 4 rpc_version 4 00000020:00100000:3.0:1787096579.070793:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096579.070801:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961742db3100 x1873906353963136/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096579.070822:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353963136:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096579.070864:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.070958:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742c273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096579.071000:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353963136 00000100:00100000:0.0:1787096579.071007:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353963136 00000100:00100000:0.0:1787096579.071087:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787096579.071096:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906353963136:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096579.072211:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7416:x1873906353963136:12345-0@lo:1000:osp_up0-1.0 Request processed in 1115us (1345us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1787096579.072220:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787096579.072302:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db3100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353963136:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787096579.072564:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.072581:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.072603:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.072622:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.072629:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.072635:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.072663:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.072670:0:8109:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.072678:0:8109:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096579.072694:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850226680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353963264:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787096579.072725:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.072786:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096579.072817:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353963264 00000100:00100000:0.0:1787096579.072822:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353963264 00000100:00100000:0.0:1787096579.072880:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787096579.072888:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8109:x1873906353963264:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787096579.072901:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096579.072914:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f800/0xa979d75fc166bc67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bc60 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.072944:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f800/0xa979d75fc166bc67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bc60 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.072954:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f800/0xa979d75fc166bc67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bc60 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.072973:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff961741937200) 00010000:00010000:0.0:1787096579.072975:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096579.072979:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340f800, rc 0) 00000100:00100000:0.0:1787096579.073018:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8109:x1873906353963264:12345-0@lo:101:mdt00_003.0 Request processed in 131us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.073024:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787096579.073076:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850226680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8109:1873906353963264:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787096579.073089:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073099:0:8109:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096579.073118:0:8109:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b38b2ece reply state 0000000092edf325 transno 4294967299 ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073130:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3800/0xa979d75fc166bc59 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073137:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9618472ca500) 00010000:00010000:2.0:1787096579.073139:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096579.073142:0:8109:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787096579.073148:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073155:0:8109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096579.073164:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x2:0x0] 00000004:00010000:2.0:1787096579.073179:0:8109:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b38b2ece reply state 0000000092edf325 transno 4294967299 ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073189:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d3000/0xa979d75fc166bc52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073195:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9618472ca100) 00010000:00010000:2.0:1787096579.073197:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096579.073199:0:8109:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787096579.073205:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00080000:2.0:1787096579.073213:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096579.073220:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073228:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073235:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073264:0:8109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096579.073269:0:8109:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096579.073274:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.073281:0:8109:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096579.073362:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+7:33721:x1873906345494528:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 37731us (37934us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787096579.073378:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 146 00010000:00010000:3.0:1787096579.073470:0:7858:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096579.073476:0:7858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.073484:0:7858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618429d3600 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096579.073489:0:7858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096579.073498:0:7858:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.073523:0:7858:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.073531:0:7858:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096579.073556:0:7858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.073563:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d3600/0xa979d75fc166bc36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bc3d expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.073582:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096579.073584:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096579.073585:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096579.073734:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787096579.073746:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353963392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787096579.073776:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.073944:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353963392 00000100:00100000:3.0:1787096579.073949:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353963392 00000100:00100000:3.0:1787096579.074022:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787096579.074030:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3634:x1873906353963392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096579.074046:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096579.074128:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030e00/0xa979d75fc166bc3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166bc36 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.074140:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca000) 00010000:00010000:3.0:1787096579.074158:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096579.074196:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3634:x1873906353963392:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.074202:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787096579.074252:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353963392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787096579.091801:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096579.091908:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345494784 00000100:00100000:1.0:1787096579.091927:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345494784 00000100:00100000:1.0:1787096579.092026:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 147 00000100:00100000:1.0:1787096579.092037:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+5:33724:x1873906345494784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096579.092057:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096579.092077:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166bc6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1f99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.092151:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166bc75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.092165:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166bc75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.092176:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166bc75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096579.092220:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096579.092224:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096579.092242:0:6488:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166bc75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.092264:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166bc6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f99 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.092280:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166bc75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1f99 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.092289:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096579.092292:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096579.092296:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618429d3600, rc 0) 00000100:00100000:1.0:1787096579.092348:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+6:33724:x1873906345494784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 313us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.092354:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 147 00000100:00100000:3.0:1787096579.093666:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.093750:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345494912 00000100:00100000:2.0:1787096579.093756:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345494912 00000100:00100000:2.0:1787096579.093793:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 148 00000100:00100000:2.0:1787096579.093800:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+6:33724:x1873906345494912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096579.093812:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096579.093822:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1fa0 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.093858:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.093868:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.093876:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.093886:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.093895:0:9989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc4b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bc44 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.093928:0:9989:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.093957:0:9989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa979d75fc166bc44 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096579.093973:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9989:1873906353963520:0@lo:104: 00000100:00100000:2.0:1787096579.094010:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096579.094128:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35900 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.094251:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353963520 00000100:00100000:3.0:1787096579.094255:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353963520 00000100:00100000:3.0:1787096579.094314:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787096579.094322:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9989:x1873906353963520:12345-0@lo:104: 00010000:00010000:3.0:1787096579.094332:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.094385:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787096579.094392:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9989:x1873906353963520:12345-0@lo:104: Request processed in 71us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.094400:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787096579.094418:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9989:1873906353963520:0@lo:104: 00010000:00010000:0.0:1787096579.094436:0:9989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.094463:0:6476:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096579.094470:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.094487:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b600 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:1.0:1787096579.094492:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096579.094500:0:6476:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.094526:0:6476:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.094532:0:6476:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096579.094558:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.094565:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166bc44 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bc4b expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.094585:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096579.094586:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353963648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096579.094587:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096579.094590:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096579.094622:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.094739:0:6473:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353963648 00000100:00100000:1.0:1787096579.094744:0:6473:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353963648 00010000:00010000:1.0:1787096579.094762:0:6473:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa979d75fc166bc44 expref: 8 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096579.094787:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787096579.094794:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3636:x1873906353963648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096579.094812:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787096579.096638:0:6467:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967358 is committed 00010000:00010000:1.0:1787096579.097205:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961840030c00/0xa979d75fc166bc4b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa979d75fc166bc44 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.097226:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff96184a9ead00) 00010000:00010000:1.0:1787096579.097231:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.097240:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.097247:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.097269:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096579.097336:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1873906353963648:12345-0@lo:103:ldlm_bl.0 Request processed in 2541us (2711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.097347:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787096579.097368:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353963648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096579.097369:0:9989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.097381:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096579.097510:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9989:1873906353963776:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787096579.097553:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096579.097577:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742971cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.097605:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353963776 00000100:00100000:3.0:1787096579.097612:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353963776 00000100:00100000:3.0:1787096579.097647:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787096579.097655:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9989:x1873906353963776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096579.097722:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9989:x1873906353963776:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.097737:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787096579.098118:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:9989:1873906353963776:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787096579.098160:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166bc91 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098172:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166bc91 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098188:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166bc91 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096579.098210:0:9989:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166bc91 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098221:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098227:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098232:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098237:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4ac00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096579.098241:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098248:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098256:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096579.098259:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096579.098262:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098268:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166bc83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098277:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098287:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098292:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098297:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096579.098300:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098305:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098312:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff96184a9ead00) 00010000:00010000:0.0:1787096579.098314:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096579.098316:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098321:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166bc8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098358:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4a600/0xa979d75fc166bc7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fa0 expref: 8 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098369:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e400/0xa979d75fc166bc91 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fa0 expref: 7 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.098376:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff961741937700) 00010000:00010000:0.0:1787096579.098378:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787096579.098386:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e400, rc 0) 00000100:00100000:0.0:1787096579.098434:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+7:33724:x1873906345494912:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 4634us (4770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.098470:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 148 00000100:00100000:0.0:1787096579.100117:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.102066:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345495040 00000100:00100000:2.0:1787096579.102076:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345495040 00000100:00100000:3.0:1787096579.102327:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 7 00000100:00100000:3.0:1787096579.102338:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:70e19547-606a-4706-b016-3476e377d7df+7:33724:x1873906345495040:12345-192.168.201.40@tcp:900:lfs.0 00000100:00100000:3.0:1787096579.102422:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:70e19547-606a-4706-b016-3476e377d7df+7:33724:x1873906345495040:12345-192.168.201.40@tcp:900:lfs.0 Request processed in 87us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.102430:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 7 00000100:00100000:3.0:1787096579.104183:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.104248:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345495168 00000100:00100000:2.0:1787096579.104258:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345495168 00000100:00100000:2.0:1787096579.104309:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 149 00000100:00100000:2.0:1787096579.104318:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+7:33724:x1873906345495168:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096579.104341:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096579.104369:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bc98 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1fa7 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.104495:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b400/0xa979d75fc166bc9f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.104512:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b400/0xa979d75fc166bc9f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.104525:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b400/0xa979d75fc166bc9f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096579.104670:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096579.104675:0:8109:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096579.104710:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bc98 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fa7 expref: 9 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.104725:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b400/0xa979d75fc166bc9f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fa7 expref: 8 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.104732:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9618472ca100) 00010000:00010000:2.0:1787096579.104735:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787096579.104738:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4b400, rc 0) 00000100:00100000:2.0:1787096579.104795:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+8:33724:x1873906345495168:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 477us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096579.104801:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 149 00000100:00100000:0.0:1787096579.107111:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096579.107146:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345495296 00000100:00100000:1.0:1787096579.107156:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345495296 00000100:00100000:1.0:1787096579.107213:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 150 00000100:00100000:1.0:1787096579.107225:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961743414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+8:33724:x1873906345495296:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096579.107244:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096579.107260:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d2a00/0xa979d75fc166bca6 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1fae expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.107312:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d2600/0xa979d75fc166bcad lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.107340:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d2600/0xa979d75fc166bcad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.107351:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d2600/0xa979d75fc166bcad lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096579.107391:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1787096579.107395:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096579.107424:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d2a00/0xa979d75fc166bca6 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fae expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.107459:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d2600/0xa979d75fc166bcad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fae expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.107467:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9618472ca500) 00010000:00010000:1.0:1787096579.107470:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096579.107473:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618429d2600, rc 0) 00000100:00100000:1.0:1787096579.107530:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961743414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+9:33724:x1873906345495296:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 309us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.107538:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 150 00000100:00100000:0.0:1787096579.108665:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.108721:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345495424 00000100:00100000:2.0:1787096579.108732:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345495424 00000100:00100000:2.0:1787096579.108788:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 151 00000100:00100000:2.0:1787096579.108801:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+7:33724:x1873906345495424:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096579.108821:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096579.108841:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ba00/0xa979d75fc166bcb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1fb5 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.108901:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.108928:0:9989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f800/0xa979d75fc166bc67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bc60 expref: 5 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.108950:0:9989:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.108989:0:9989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f800/0xa979d75fc166bc67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa979d75fc166bc60 expref: 5 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096579.109009:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9989:1873906353963904:0@lo:104: 00000100:00100000:2.0:1787096579.109075:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.109126:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353963904 00000100:00100000:1.0:1787096579.109135:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353963904 00000100:00100000:2.0:1787096579.109151:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35600 going to sleep for 11 seconds 00000100:00100000:1.0:1787096579.109194:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787096579.109202:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9989:x1873906353963904:12345-0@lo:104: 00010000:00010000:1.0:1787096579.109216:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.109295:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096579.109309:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9989:x1873906353963904:12345-0@lo:104: Request processed in 108us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.109317:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787096579.109331:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9989:1873906353963904:0@lo:104: 00010000:00010000:2.0:1787096579.109354:0:9989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.109385:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096579.109392:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.109401:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618429d2400 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:0.0:1787096579.109407:0:10297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096579.109415:0:10297:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.109510:0:10297:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.109517:0:10297:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787096579.109562:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353964032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096579.109595:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096579.109648:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353964032 00010000:00010000:0.0:1787096579.109649:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096579.109656:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353964032 00010000:00010000:0.0:1787096579.109663:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9618429d2400/0xa979d75fc166bc60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166bc67 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.109685:0:6474:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f800/0xa979d75fc166bc67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa979d75fc166bc60 expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.109689:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096579.109700:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096579.109706:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096579.109722:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787096579.109731:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1873906353964032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096579.109743:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096579.110126:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f800/0xa979d75fc166bc67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa979d75fc166bc60 expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.110140:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff961741937200) 00010000:00010000:2.0:1787096579.110143:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.110158:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.110165:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.110190:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096579.110223:0:9989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.110232:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096579.110243:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353964032:12345-0@lo:103:ldlm_bl.0 Request processed in 513us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096579.110262:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000004:00200000:0.0:1787096579.110278:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1787096579.110284:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787096579.110330:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ba00/0xa979d75fc166bcb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fb5 expref: 9 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096579.110350:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353964032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096579.110352:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166bcbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fb5 expref: 8 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.110366:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff961741937200) 00010000:00010000:0.0:1787096579.110370:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096579.110373:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4bc00, rc 0) 00000100:00100000:0.0:1787096579.110419:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+8:33724:x1873906345495424:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 1623us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.110426:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 151 00000100:00100000:3.0:1787096579.111757:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.111808:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345495552 00000100:00100000:2.0:1787096579.111817:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345495552 00000100:00100000:2.0:1787096579.111869:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 152 00000100:00100000:2.0:1787096579.111878:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+9:33724:x1873906345495552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096579.111897:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096579.111915:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bcc2 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1fbc expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.111996:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112018:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112029:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112172:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112210:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112222:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112274:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112282:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112288:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112295:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112300:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4aa00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096579.112304:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112311:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112323:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9618472ca500) 00010000:00010000:2.0:1787096579.112326:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096579.112330:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112336:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166bcc9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112354:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112360:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112366:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112372:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4a600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096579.112375:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112381:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112389:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x7b711ae6 (ffff961742a27c00) 00010000:00010000:2.0:1787096579.112391:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096579.112394:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112399:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a600/0xa979d75fc166bcd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112433:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bcc2 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fbc expref: 10 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112486:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9618472ca500) 00010000:00010000:2.0:1787096579.112488:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096579.112499:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a000/0xa979d75fc166bcc2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fbc expref: 10 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.112510:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4a000, rc 0) 00000100:00100000:2.0:1787096579.112567:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+9:33724:x1873906345495552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 689us (812us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096579.112575:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 152 00000100:00100000:3.0:1787096579.114231:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096579.114288:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345495808 00000100:00100000:1.0:1787096579.114299:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345495808 00000100:00100000:1.0:1787096579.114356:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 153 00000100:00100000:1.0:1787096579.114368:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+9:33724:x1873906345495808:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096579.114395:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096579.114398:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787096579.114421:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9618429d2600/0xa979d75fc166bcad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fae expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.114646:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9618472ca500) 00010000:00010000:1.0:1787096579.114651:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096579.114664:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6600/0xa979d75fc166bcd7 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1fc3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.114768:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96185b1d6000/0xa979d75fc166bcde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.114777:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff96185b1d6000/0xa979d75fc166bcde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.114788:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff96185b1d6000/0xa979d75fc166bcde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096579.114831:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850227b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353964160:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787096579.114889:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.114937:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787096579.114944:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353964160 00000100:00100000:0.0:1787096579.114956:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353964160 00000100:00100000:0.0:1787096579.115016:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787096579.115028:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6488:x1873906353964160:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787096579.115047:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096579.115064:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166bce5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166bcde expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.115103:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166bce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166bcde expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.115115:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166bce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166bcde expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096579.115123:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096579.115126:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787096579.115129:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340f200, rc 0) 00000100:00100000:0.0:1787096579.115187:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6488:x1873906353964160:12345-0@lo:101:mdt00_000.0 Request processed in 163us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.115193:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787096579.115233:0:6488:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967358 gen 2 00000004:00080000:1.0:1787096579.115240:0:6488:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967358 committed transno 4294967358 00000100:00100000:1.0:1787096579.115301:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850227b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353964160:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787096579.115319:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff96185b1d6000/0xa979d75fc166bcde lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bce5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.115332:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff96185b1d6000/0xa979d75fc166bcde lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166bce5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096579.115350:0:6488:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787096579.115358:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff96185b1d6000/0xa979d75fc166bcde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bce5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.115367:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff96185b1d6000/0xa979d75fc166bcde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166bce5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.115425:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 3/0,1 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.115436:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.115502:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.115530:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.115539:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.115546:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096579.115691:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850227b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353964288:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787096579.115724:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096579.115764:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618754e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096579.115773:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353964288 00000100:00100000:3.0:1787096579.115780:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353964288 00000100:00100000:3.0:1787096579.115819:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787096579.115829:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6488:x1873906353964288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787096579.115891:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6488:x1873906353964288:12345-0@lo:1000:mdt00_000.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.115897:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787096579.115955:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850227b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353964288:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787096579.116326:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116337:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116345:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096579.116357:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787096579.116385:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116392:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116399:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116412:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96185b1d6400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096579.116416:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116422:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116429:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9618472ca500) 00010000:00010000:1.0:1787096579.116431:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096579.116433:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 2/0,0 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116437:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6400/0xa979d75fc166bcec lrc: 0/0,0 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096579.116524:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005b34c721 reply state 0000000034baa317 transno 4294967300 ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116533:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6800/0xa979d75fc166bcf3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116537:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x7b711ae6 (ffff9618472cad00) 00010000:00010000:1.0:1787096579.116539:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096579.116541:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096579.116567:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96185b1d6600/0xa979d75fc166bcd7 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116576:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096579.116591:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9618472ca200) 00010000:00010000:1.0:1787096579.116593:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096579.116594:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5000, rc 0) 00000100:00100000:1.0:1787096579.116637:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+11:33724:x1873906345495808:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2273us (2412us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787096579.116641:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 153 00000100:00100000:0.0:1787096579.118672:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.118721:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345496064 00000100:00100000:2.0:1787096579.118731:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345496064 00000100:00100000:2.0:1787096579.118785:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 154 00000100:00100000:2.0:1787096579.118795:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+11:33724:x1873906345496064:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096579.118817:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096579.118835:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166bd08 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1fca expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.118958:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.118972:0:9989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.118980:0:9989:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 4/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.119010:0:9989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.119023:0:9989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 12 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096579.119056:0:9989:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9989:1873906353964416:192.168.201.40@tcp:104: 00000100:00100000:2.0:1787096579.119154:0:9989:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a35600 going to sleep for 11 seconds 00000100:00100000:2.0:1787096579.120205:0:9989:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9989:1873906353964416:192.168.201.40@tcp:104: 00010000:00010000:2.0:1787096579.120227:0:9989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096579.120499:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096579.120547:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345496192 00000100:00100000:3.0:1787096579.120558:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345496192 00010000:00010000:3.0:1787096579.120599:0:6475:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 13 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096579.120637:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 58 00000100:00100000:3.0:1787096579.120648:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618589c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70e19547-606a-4706-b016-3476e377d7df+13:2401:x1873906345496192:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096579.120707:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096579.120714:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 13 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.120742:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 13 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.120768:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5000/0xa979d75fc166bcfa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fc3 expref: 13 pid: 6488 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.120786:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9618472ca200) 00010000:00010000:3.0:1787096579.120792:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.120802:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.120811:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096579.120841:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096579.120874:0:9989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.120884:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096579.120894:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618589c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70e19547-606a-4706-b016-3476e377d7df+12:2401:x1873906345496192:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 248us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.120901:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 58 00000004:00200000:2.0:1787096579.120904:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787096579.121081:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121090:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121106:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121113:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4ac00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096579.121118:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121127:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121154:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9618472ca200) 00010000:00010000:2.0:1787096579.121157:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787096579.121162:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121169:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ac00/0xa979d75fc166bd0f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121202:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166bd08 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fca expref: 11 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121212:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9618472ca200) 00010000:00010000:2.0:1787096579.121214:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096579.121217:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166bd08 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1fca expref: 11 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096579.121232:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4b200, rc 0) 00000100:00100000:2.0:1787096579.121284:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+10:33724:x1873906345496064:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2490us (2619us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096579.121292:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 154 00000100:00100000:0.0:1787096579.122993:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096579.123059:0:6491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345496448 00000100:00100000:3.0:1787096579.123070:0:6491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345496448 00000100:00100000:3.0:1787096579.123127:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 21 00000100:00100000:3.0:1787096579.123138:0:6491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+10:33724:x1873906345496448:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1787096579.123401:0:6491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+11:33724:x1873906345496448:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 265us (412us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787096579.123412:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 21 00010000:00010000:0.0:1787096579.342727:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096579.357263:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096579.357312:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.357348:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345496576 00000100:00100000:3.0:1787096579.357350:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096579.357364:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345496576 00000100:00100000:1.0:1787096579.357389:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345496832 00000100:00100000:1.0:1787096579.357396:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345496832 00000100:00100000:2.0:1787096579.357479:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 324 00000100:00100000:1.0:1787096579.357497:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345496704 00000100:00100000:2.0:1787096579.357498:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2401:x1873906345496576:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096579.357505:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345496704 00000100:00100000:0.0:1787096579.357517:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 272 00000100:00100000:0.0:1787096579.357544:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+11:2401:x1873906345496832:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096579.357547:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 273 00000100:00100000:1.0:1787096579.357566:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+8:2401:x1873906345496704:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:2.0:1787096579.357588:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d421c913-8ded-4ece-9979-167ed163b87c+9:2401:x1873906345496576:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 98us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096579.357597:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 324 00000100:00100000:1.0:1787096579.357612:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+8:2401:x1873906345496704:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 50us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096579.357623:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 273 00000100:00100000:0.0:1787096579.357647:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+11:2401:x1873906345496832:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 113us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.357658:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 272 00000100:00100000:3.0:1787096579.662682:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef59912-d6a3-4393-bae9-348c8f3519b6:3634:1873906353964544:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.662776:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.662833:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186dfb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1873906353965056:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.662863:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.662888:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353965568:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.662931:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.662954:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353966080:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.662978:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663005:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787096579.663013:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1873906353964672:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663040:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663059:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1873906353965184:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663083:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663105:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1873906353965696:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663133:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663167:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353964800:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663206:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663232:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353965312:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663256:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663274:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1873906353965824:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663297:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663325:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787096579.663331:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1873906353964928:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663357:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663372:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353965440:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663396:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663415:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353965952:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663472:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096579.663513:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353964544 00000100:00100000:3.0:1787096579.663522:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353964544 00000100:00100000:3.0:1787096579.663571:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787096579.663581:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3634:x1873906353964544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663639:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3634:x1873906353964544:12345-0@lo:400:kworker.0 Request processed in 59us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.663647:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787096579.663685:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353965056 00000100:00100000:3.0:1787096579.663688:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353965056 00000100:00100000:3.0:1787096579.663721:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353964672 00000100:00100000:3.0:1787096579.663724:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353964672 00000100:00100000:3.0:1787096579.663737:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353965184 00000100:00100000:3.0:1787096579.663739:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353965184 00000100:00100000:3.0:1787096579.663752:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353965696 00000100:00100000:3.0:1787096579.663754:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353965696 00000100:00100000:3.0:1787096579.663768:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353965824 00000100:00100000:3.0:1787096579.663770:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353965824 00000100:00100000:3.0:1787096579.663783:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353964928 00000100:00100000:3.0:1787096579.663785:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353964928 00000100:00100000:3.0:1787096579.663800:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787096579.663806:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1873906353965056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663839:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1873906353965056:12345-0@lo:400:kworker.0 Request processed in 34us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.663851:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787096579.663863:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787096579.663868:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1873906353964672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663894:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1873906353964672:12345-0@lo:400:kworker.0 Request processed in 26us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.663900:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787096579.663926:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787096579.663932:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1873906353965184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.663959:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1873906353965184:12345-0@lo:400:kworker.0 Request processed in 28us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.663965:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787096579.663976:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787096579.663983:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1873906353965696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664011:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1873906353965696:12345-0@lo:400:kworker.0 Request processed in 29us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.664016:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787096579.664041:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787096579.664047:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1873906353965824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664076:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1873906353965824:12345-0@lo:400:kworker.0 Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.664082:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787096579.664094:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787096579.664099:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1873906353964928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664127:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1873906353964928:12345-0@lo:400:kworker.0 Request processed in 28us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.664138:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787096579.664158:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353965568 00000100:00100000:3.0:1787096579.664161:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353965568 00000100:00100000:3.0:1787096579.664186:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353966080 00000100:00100000:3.0:1787096579.664188:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353966080 00000100:00100000:3.0:1787096579.664200:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353965312 00000100:00100000:3.0:1787096579.664202:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353965312 00000100:00100000:3.0:1787096579.664215:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353965952 00000100:00100000:3.0:1787096579.664217:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353965952 00000100:00100000:3.0:1787096579.664229:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787096579.664234:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353965568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664264:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353965568:12345-0@lo:400:kworker.0 Request processed in 30us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.664270:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787096579.664280:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787096579.664286:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353966080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664311:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353966080:12345-0@lo:400:kworker.0 Request processed in 26us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.664317:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787096579.664326:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787096579.664332:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353965312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664355:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353965312:12345-0@lo:400:kworker.0 Request processed in 24us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.664361:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787096579.664370:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787096579.664375:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353965952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664420:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353965952:12345-0@lo:400:kworker.0 Request processed in 44us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096579.664426:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787096579.664490:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787096579.664494:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787096579.664497:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787096579.664500:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096579.664534:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1873906353964928:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664546:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353965952:0@lo:400:kworker.0 00010000:00080000:3.0:1787096579.664558:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742c9b100 x1873906353965312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096579.664568:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353965312:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664578:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1873906353965824:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664618:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1873906353964672:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664627:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1873906353965184:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664635:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1873906353965696:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664643:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef59912-d6a3-4393-bae9-348c8f3519b6:3634:1873906353964544:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664654:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186dfb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1873906353965056:0@lo:400:kworker.0 00010000:00080000:3.0:1787096579.664664:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961742c99880 x1873906353965568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096579.664673:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353965568:0@lo:400:kworker.0 00000100:00100000:3.0:1787096579.664697:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353966080:0@lo:400:kworker.0 00000100:00100000:0.0:1787096579.666995:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353964800 00000100:00100000:0.0:1787096579.667007:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353964800 00000100:00100000:0.0:1787096579.667054:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353965440 00000100:00100000:0.0:1787096579.667057:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353965440 00000100:00100000:0.0:1787096579.667077:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787096579.667094:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1873906353964800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096579.667188:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1873906353964800:12345-0@lo:400:kworker.0 Request processed in 96us (3980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.667197:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787096579.667218:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787096579.667225:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353965440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096579.667257:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353965440:12345-0@lo:400:kworker.0 Request processed in 33us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.667264:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787096579.667350:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787096579.667364:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353966336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096579.667405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096579.667463:0:17665:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353966336 00000100:00100000:0.0:1787096579.667467:0:17665:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353966336 00000100:00100000:0.0:1787096579.667497:0:17665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787096579.667504:0:17665:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353966336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787096579.667530:0:17665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096579.667567:0:17665:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353966336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.667574:0:17665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787096579.667611:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353966336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096579.667634:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353966208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096579.667669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096579.667699:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353966208 00000100:00100000:0.0:1787096579.667702:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353966208 00000100:00100000:0.0:1787096579.667726:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787096579.667739:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186e2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353966208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787096579.667750:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096579.667778:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186e2f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353966208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096579.667785:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787096579.668055:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353966208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096579.668081:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353965440:0@lo:400:kworker.0 00000100:00100000:0.0:1787096579.668094:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850196300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353964800:0@lo:400:kworker.0 00000001:02000400:3.0:1787096579.717617:0:21783:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_23a: @@@@@@ FAIL: setstripe failed 00000100:00100000:1.0:1787096580.179653:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353966464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096580.179722:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096580.179794:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353966464 00000100:00100000:1.0:1787096580.179803:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353966464 00000100:00100000:1.0:1787096580.179847:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787096580.179856:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1873906353966464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787096580.179891:0:6493:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446223872 avail 1299984384 00000100:00100000:1.0:1787096580.179943:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1873906353966464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096580.179949:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787096580.180003:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353966464:0@lo:41:osp-pre-0-1.0 Debug log: 2274 lines, 2274 kept, 0 dropped, 0 bad.