00000100:00100000:1.0F:1787096533.152829:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0F:1787096533.152878:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345479936 00000100:00100000:3.0:1787096533.152893:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345479936 00000100:00080000:1.0:1787096533.152953:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096533.152989:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 98 00000100:00100000:3.0:1787096533.153000:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+10:24137:x1873906345479936:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:3.0:1787096533.153026:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096533.153048:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4600/0xa979d75fc166b831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1e81 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.153124:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166b838 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.153136:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166b838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.153150:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166b838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096533.153199:0:6490:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096533.153203:0:6490:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096533.153224:0:6490:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166b838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.153250:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4600/0xa979d75fc166b831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e81 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.153271:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166b838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e81 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.153281:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961862853000) 00010000:00010000:3.0:1787096533.153285:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096533.153289:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618821e4200, rc 0) 00000100:00100000:3.0:1787096533.153371:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+11:24137:x1873906345479936:12345-192.168.201.40@tcp:101:rm.0 Request processed in 368us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096533.153379:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 98 00000100:00100000:1.0:1787096533.154405:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0F:1787096533.154635:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480064 00000100:00100000:2.0:1787096533.154648:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480064 00000100:00100000:2.0:1787096533.154707:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 99 00000100:00100000:2.0:1787096533.154716:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+11:24137:x1873906345480064:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096533.154729:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096533.154742:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166b83f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1e88 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154786:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154796:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154805:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154815:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154822:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154827:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154900:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166b854 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154907:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166b854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154913:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166b854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096533.154959:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787096533.154963:0:8109:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096533.154977:0:8109:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166b854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154987:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166b854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.154995:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155002:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155009:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155014:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096533.155019:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155026:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155037:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961862853000) 00010000:00010000:2.0:1787096533.155040:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096533.155043:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155049:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4b200/0xa979d75fc166b846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155068:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155074:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155079:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155084:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4ae00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096533.155086:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155090:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155098:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x328fd2b2 (ffff961862853200) 00010000:00010000:2.0:1787096533.155100:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096533.155102:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155108:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ae00/0xa979d75fc166b84d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155129:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4be00/0xa979d75fc166b83f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e88 expref: 13 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155140:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166b854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e88 expref: 12 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096533.155155:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961742a27c00) 00010000:00010000:2.0:1787096533.155157:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096533.155160:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4ac00, rc 0) 00000100:00100000:2.0:1787096533.155206:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+12:24137:x1873906345480064:12345-192.168.201.40@tcp:101:rm.0 Request processed in 492us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.155212:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 99 00000100:00100000:0.0F:1787096533.157708:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096533.157760:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480320 00000100:00100000:1.0:1787096533.157769:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480320 00000100:00100000:1.0:1787096533.157812:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 100 00000100:00100000:1.0:1787096533.157821:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+12:24137:x1873906345480320:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:1.0:1787096533.157870:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787096533.157899:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166b854 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e88 expref: 12 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.157914:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961742a27c00) 00010000:00010000:1.0:1787096533.157926:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618821e4200/0xa979d75fc166b838 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e81 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.157935:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961862853000) 00010000:00010000:1.0:1787096533.157940:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096533.157960:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.157971:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.157978:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.157986:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166b862 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.157991:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166b862 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158004:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166b862 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158086:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158094:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158102:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158299:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158309:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158317:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158325:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158332:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158337:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158352:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096533.158367:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.158374:0:7858:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096533.158377:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.158382:0:7858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158386:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.158396:0:7858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618429d2600 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:1.0:1787096533.158399:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618429d3000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096533.158402:0:7858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158404:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.158415:0:7858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158417:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.158432:0:7858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9618472ca200) 00010000:00010000:0.0:1787096533.158435:0:7858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787096533.158460:0:7858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.158467:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2600/0xa979d75fc166b870 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.158481:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096533.158483:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096533.158485:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096533.158822:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9618472ca200) 00010000:00010000:1.0:1787096533.158826:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096533.158829:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158834:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3000/0xa979d75fc166b869 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158850:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158854:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158858:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158861:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618429d2a00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096533.158867:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158871:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158881:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472cae00) 00010000:00010000:1.0:1787096533.158883:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096533.158885:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158891:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d2a00/0xa979d75fc166b85b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096533.158904:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d048f985 reply state 00000000b2233154 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166b862 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158913:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618429d3600/0xa979d75fc166b862 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.158918:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x328fd2b2 (ffff961862853200) 00010000:00010000:1.0:1787096533.158920:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096533.158922:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787096533.158989:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+12:24137:x1873906345480320:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1169us (1304us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787096533.158995:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 100 00010000:00010000:0.0:1787096533.262591:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096533.279095:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096533.279139:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096533.279188:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480704 00000100:00100000:2.0:1787096533.279201:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480704 00000100:00100000:3.0:1787096533.279211:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096533.279213:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480576 00000100:00100000:0.0:1787096533.279220:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480576 00000100:00080000:3.0:1787096533.279265:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096533.279285:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480448 00000100:00100000:0.0:1787096533.279285:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 200 00000100:00100000:1.0:1787096533.279293:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480448 00000100:00100000:2.0:1787096533.279297:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 201 00000100:00100000:0.0:1787096533.279302:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+12:2400:x1873906345480576:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:2.0:1787096533.279312:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345480704:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:1.0:1787096533.279341:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 306 00000100:00100000:1.0:1787096533.279352:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96184842fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d421c913-8ded-4ece-9979-167ed163b87c+9:2400:x1873906345480448:12345-192.168.201.40@tcp:400:kworker.0 00000100:00100000:0.0:1787096533.279412:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+12:2400:x1873906345480576:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.279413:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+5:2401:x1873906345480704:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096533.279414:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96184842fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d421c913-8ded-4ece-9979-167ed163b87c+9:2400:x1873906345480448:12345-192.168.201.40@tcp:400:kworker.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.279427:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 201 00000100:00100000:1.0:1787096533.279472:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 306 00000100:00100000:0.0:1787096533.279491:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 200 00000100:00100000:1.0:1787096533.582645:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353939456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096533.582645:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353939328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096533.582694:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906353939584:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.582731:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096533.582738:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef59912-d6a3-4393-bae9-348c8f3519b6:3637:1873906353939200:0@lo:400:kworker.0 00000100:00100000:3.0:1787096533.582776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096533.582808:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096533.582818:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1873906353939968:0@lo:400:kworker.0 00000100:00100000:2.0:1787096533.582826:0:17665:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353939456 00000100:00100000:2.0:1787096533.582836:0:17665:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353939456 00000100:00100000:3.0:1787096533.582839:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906353940096:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.582858:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096533.582858:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1873906353939840:0@lo:400:kworker.0 00000100:00100000:3.0:1787096533.582897:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353939200 00000100:00100000:3.0:1787096533.582903:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353939200 00000100:00100000:1.0:1787096533.582916:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353940480:0@lo:400:kworker.0 00000100:00100000:0.0:1787096533.582927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096533.582937:0:17665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787096533.582948:0:17665:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353939456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096533.582955:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096533.582975:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00002000:00000024:2.0:1787096533.582982:0:17665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096533.582983:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353940352:0@lo:400:kworker.0 00000100:00100000:3.0:1787096533.582990:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96184842c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3637:x1873906353939200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.582995:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353940992:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.583054:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096533.583055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096533.583060:0:17665:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353939456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.583073:0:17665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787096533.583097:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96184842c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef59912-d6a3-4393-bae9-348c8f3519b6+23:3637:x1873906353939200:12345-0@lo:400:kworker.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096533.583106:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:2.0:1787096533.583107:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096533.583112:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353940864:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.583134:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353939456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096533.583142:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096533.583155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096533.583183:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353939712:0@lo:400:kworker.0 00000100:00100000:3.0:1787096533.583198:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353939584 00000100:00100000:1.0:1787096533.583201:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353939968 00000100:00100000:3.0:1787096533.583202:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353939584 00000100:00100000:1.0:1787096533.583210:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353939968 00000100:00100000:0.0:1787096533.583216:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef59912-d6a3-4393-bae9-348c8f3519b6:3637:1873906353939200:0@lo:400:kworker.0 00000100:00100000:2.0:1787096533.583241:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096533.583258:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353940480 00000100:00100000:0.0:1787096533.583264:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353940480 00000100:00100000:3.0:1787096533.583274:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353939840 00000100:00100000:3.0:1787096533.583279:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353939840 00000100:00100000:2.0:1787096533.583285:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353940224:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.583292:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787096533.583312:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787096533.583312:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906353939584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096533.583319:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353940992 00000100:00100000:2.0:1787096533.583324:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096533.583326:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1873906353939968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096533.583329:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353940992 00000100:00100000:2.0:1787096533.583352:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1873906353940736:0@lo:400:kworker.0 00000100:00100000:0.0:1787096533.583366:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353940864 00000100:00100000:0.0:1787096533.583370:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353940864 00000100:00100000:1.0:1787096533.583380:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1873906353939584:12345-0@lo:400:kworker.0 Request processed in 77us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096533.583391:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787096533.583392:0:10250:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353940224 00000100:00100000:0.0:1787096533.583396:0:10250:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353940224 00000100:00100000:2.0:1787096533.583403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096533.583418:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1873906353939968:12345-0@lo:400:kworker.0 Request processed in 94us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096533.583427:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353940736 00000100:00100000:1.0:1787096533.583433:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353940736 00000100:00100000:3.0:1787096533.583434:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787096533.583437:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787096533.583489:0:8453:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353939328 00000100:00100000:2.0:1787096533.583494:0:8453:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353939328 00000100:00100000:3.0:1787096533.583514:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787096533.583515:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353940480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.583534:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787096533.583539:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1873906353939840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096533.583547:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787096533.583552:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1873906353940736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096533.583562:0:8453:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1873906353939328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096533.583568:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1873906353940480:12345-0@lo:400:kworker.0 Request processed in 75us (612us total) trans 0 rc 0/0 00002000:00000024:2.0:1787096533.583574:0:8453:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096533.583578:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787096533.583602:0:10250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787096533.583613:0:10250:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186e0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3634:x1873906353940992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096533.583629:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1873906353939840:12345-0@lo:400:kworker.0 Request processed in 94us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.583635:0:8453:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1873906353939328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096533.583636:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1873906353940736:12345-0@lo:400:kworker.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096533.583656:0:10250:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186e0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3634:x1873906353940992:12345-0@lo:400:kworker.0 Request processed in 43us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096533.583662:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787096533.583663:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787096533.583675:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787096533.583703:0:10250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787096533.583724:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353940352 00000100:00100000:2.0:1787096533.583729:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353940352 00000100:00100000:3.0:1787096533.583738:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1873906353939840:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.583762:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787096533.583779:0:8456:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353940864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096533.583785:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353939712 00000100:00100000:2.0:1787096533.583789:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353939712 00000100:00100000:3.0:1787096533.583810:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787096533.583825:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353940224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096533.583830:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787096533.583844:0:8456:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1873906353940864:12345-0@lo:400:kworker.0 Request processed in 69us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.583847:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353940352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.583860:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787096533.583896:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353940224:12345-0@lo:400:kworker.0 Request processed in 76us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096533.583904:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787096533.583917:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353940352:12345-0@lo:400:kworker.0 Request processed in 74us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096533.583917:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787096533.583929:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787096533.583933:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353939712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.583984:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1873906353939712:12345-0@lo:400:kworker.0 Request processed in 56us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096533.583991:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787096533.584001:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787096533.584006:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787096533.584011:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787096533.584014:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096533.584031:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096533.584047:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353939712:0@lo:400:kworker.0 00000100:00100000:2.0:1787096533.584071:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187bb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906353940608:0@lo:400:kworker.0 00010000:00080000:1.0:1787096533.584075:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96187bb2fb80 x1873906353940224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096533.584089:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353940224:0@lo:400:kworker.0 00000100:00100000:0.0:1787096533.584094:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1873906353940864:0@lo:400:kworker.0 00010000:00080000:1.0:1787096533.584117:0:3636:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96187bb2c700 x1873906353940736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096533.584117:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353940352:0@lo:400:kworker.0 00000100:00100000:2.0:1787096533.584118:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096533.584134:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1873906353940736:0@lo:400:kworker.0 00000100:00100000:0.0:1787096533.584160:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353940096 00000100:00100000:1.0:1787096533.584163:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742de9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353939328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096533.584164:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353940096 00000100:00100000:2.0:1787096533.584168:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1873906353939584:0@lo:400:kworker.0 00000100:00080000:2.0:1787096533.584201:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096533.584201:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353940608 00000100:00100000:0.0:1787096533.584206:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353940608 00000100:00100000:1.0:1787096533.584212:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787096533.584223:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906353940096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787096533.584227:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096533.584249:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787096533.584253:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1873906353939968:0@lo:400:kworker.0 00000100:00100000:0.0:1787096533.584265:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906353940608:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787096533.584271:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96187bb2df80 x1873906353940480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096533.584278:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353940480:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.584283:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1873906353940096:12345-0@lo:400:kworker.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.584292:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1873906353940992:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.584294:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787096533.584311:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1873906353940608:12345-0@lo:400:kworker.0 Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096533.584319:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00080000:1.0:1787096533.584348:0:3635:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96187bb2f800 x1873906353940096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096533.584358:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1873906353940096:0@lo:400:kworker.0 00000100:00100000:1.0:1787096533.584369:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187bb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1873906353940608:0@lo:400:kworker.0 00000001:02000400:2.0:1787096533.761169:0:18336:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 19:42:12 (1787096532) 00000100:00100000:3.0:1787096533.811409:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096533.811468:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480832 00000100:00100000:0.0:1787096533.811479:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480832 00000100:00100000:0.0:1787096533.811555:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 101 00000100:00100000:0.0:1787096533.811567:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+12:24304:x1873906345480832:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096533.811588:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096533.811608:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166b877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1e8f expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.811663:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166b87e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.811675:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166b87e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.811696:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166b87e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096533.811737:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096533.811740:0:8109:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096533.811756:0:8109:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166b87e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.811777:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166b877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e8f expref: 14 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.811802:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166b87e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e8f expref: 13 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.811812:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961741937c00) 00010000:00010000:0.0:1787096533.811815:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096533.811818:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340ee00, rc 0) 00000100:00100000:0.0:1787096533.811868:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+13:24304:x1873906345480832:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 304us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096533.811876:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 101 00000100:00100000:3.0:1787096533.813813:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096533.813851:0:6490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345480960 00000100:00100000:0.0:1787096533.813860:0:6490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345480960 00000100:00100000:0.0:1787096533.813910:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 102 00000100:00100000:0.0:1787096533.813922:0:6490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+13:24304:x1873906345480960:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096533.813938:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096533.813952:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166b885 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1e96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814002:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814026:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814036:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814058:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814067:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814074:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814108:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814116:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814123:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814130:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340fc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096533.814134:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814151:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814163:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961741937c00) 00010000:00010000:0.0:1787096533.814172:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096533.814177:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814184:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fc00/0xa979d75fc166b88c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814203:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814210:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814217:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814222:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340ea00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096533.814224:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814230:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814238:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57a32597 (ffff961741937800) 00010000:00010000:0.0:1787096533.814241:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096533.814245:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814251:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b893 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814282:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166b885 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e96 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814303:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961741937c00) 00010000:00010000:0.0:1787096533.814306:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096533.814310:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166b885 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e96 expref: 14 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.814319:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340f200, rc 0) 00000100:00100000:0.0:1787096533.814366:0:6490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:70e19547-606a-4706-b016-3476e377d7df+13:24304:x1873906345480960:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 447us (558us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096533.814379:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 102 00000100:00100000:3.0:1787096533.816532:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096533.816572:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345481216 00000100:00100000:0.0:1787096533.816580:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345481216 00000100:00100000:0.0:1787096533.816625:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 103 00000100:00100000:0.0:1787096533.816635:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+13:24304:x1873906345481216:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096533.816652:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096533.816655:0:9989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787096533.816673:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166b87e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e8f expref: 13 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.816699:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961741937c00) 00010000:00010000:0.0:1787096533.816710:0:9989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096533.816729:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166b89a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1e9d expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.816802:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.816824:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.816832:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.816845:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ec00/0xa979d75fc166b8a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x57a32597 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.816850:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ec00/0xa979d75fc166b8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.816855:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ec00/0xa979d75fc166b8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817195:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817202:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817207:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096533.817215:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xc:0x0]: returning size 0 00010000:00010000:0.0:1787096533.817242:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817250:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817257:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817268:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340fe00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096533.817271:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817276:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817283:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961741937b00) 00010000:00010000:0.0:1787096533.817285:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096533.817288:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817291:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166b8a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096533.817298:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000037cd79f9 reply state 0000000045604bfb transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ec00/0xa979d75fc166b8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817305:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ec00/0xa979d75fc166b8a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817308:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57a32597 (ffff961741937500) 00010000:00010000:0.0:1787096533.817310:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096533.817312:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096533.817331:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166b89a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 15 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817341:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 14 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.817354:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff961741937f00) 00010000:00010000:0.0:1787096533.817356:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096533.817357:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e800, rc 0) 00000100:00100000:0.0:1787096533.817410:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+15:24304:x1873906345481216:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 776us (884us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787096533.817417:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 103 00000100:00100000:3.0:1787096533.819208:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096533.819263:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345481472 00000100:00100000:0.0:1787096533.819271:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345481472 00000100:00100000:0.0:1787096533.819328:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 104 00000100:00100000:0.0:1787096533.819341:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+15:24304:x1873906345481472:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096533.819361:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096533.819378:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166b8bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b1ea4 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.819486:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.819501:0:8109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 16 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.819522:0:8109:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.819557:0:8109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 16 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096533.819571:0:8109:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 16 pid: 9989 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096533.819593:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8109:1873906353941120:192.168.201.40@tcp:104: 00000100:00100000:0.0:1787096533.819672:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741d70900 going to sleep for 11 seconds 00000100:00100000:0.0:1787096533.820484:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8109:1873906353941120:192.168.201.40@tcp:104: 00010000:00010000:0.0:1787096533.820508:0:8109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096533.821598:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096533.821637:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345481600 00000100:00100000:1.0:1787096533.821644:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345481600 00010000:00010000:1.0:1787096533.821673:0:8380:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 17 pid: 9989 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096533.821716:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 49 00000100:00100000:1.0:1787096533.821726:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+17:2401:x1873906345481600:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096533.821738:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096533.821745:0:8380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 17 pid: 9989 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.821759:0:8380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 17 pid: 9989 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.821780:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e800/0xa979d75fc166b8af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1e9d expref: 17 pid: 9989 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.821794:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff961741937f00) 00010000:00010000:1.0:1787096533.821799:0:8380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.821807:0:8380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.821822:0:8380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096533.821849:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096533.821871:0:8109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.821881:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096533.821896:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+16:2401:x1873906345481600:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 170us (298us total) trans 0 rc 0/0 00000004:00200000:3.0:1787096533.821898:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xc:0x0]: returning size 0 00000100:00100000:1.0:1787096533.821909:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 49 00010000:00010000:3.0:1787096533.822092:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822101:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822108:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822121:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340ea00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096533.822126:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822134:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822145:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff961741937f00) 00010000:00010000:3.0:1787096533.822149:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787096533.822153:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822158:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ea00/0xa979d75fc166b8c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822202:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166b8bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1ea4 expref: 15 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822212:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961741937800) 00010000:00010000:3.0:1787096533.822214:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096533.822218:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f200/0xa979d75fc166b8bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b1ea4 expref: 15 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096533.822233:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340f200, rc 0) 00000100:00100000:3.0:1787096533.822269:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+14:24304:x1873906345481472:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2932us (3064us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096533.822277:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 104 00000100:00100000:1.0:1787096533.823437:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096533.823494:0:6491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345481856 00000100:00100000:3.0:1787096533.823506:0:6491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345481856 00000100:00100000:3.0:1787096533.823558:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 15 00000100:00100000:3.0:1787096533.823570:0:6491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+14:24304:x1873906345481856:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:3.0:1787096533.823766:0:6491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:70e19547-606a-4706-b016-3476e377d7df+15:24304:x1873906345481856:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 200us (332us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1787096533.823775:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 15 00000100:00100000:1.0:1787096534.095617:0:3635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353941248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787096534.095699:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096534.095743:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353941248 00000100:00100000:2.0:1787096534.095752:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353941248 00000100:00100000:2.0:1787096534.095809:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787096534.095818:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353941248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096534.095851:0:7418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787096534.095903:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1873906353941248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096534.095912:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787096534.095948:0:3635:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1873906353941248:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787096534.286542:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096534.301374:0:18384:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_5b: @@@@@@ FAIL: setstripe failed Debug log: 481 lines, 481 kept, 0 dropped, 0 bad.