00010000:00010000:2.0F:1787096618.888272:0:8267:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1787096619.512961:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1787096619.513382:0:10897:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359164928 00000100:00100000:2.0:1787096619.513395:0:10897:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359164928 00000100:00100000:2.0:1787096619.513466:0:10897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 285 00000100:00100000:2.0:1787096619.513479:0:10897:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+13:40013:x1873906359164928:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:2.0:1787096619.513509:0:10897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096619.513535:0:10897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2aea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f02a84f880c8b27 expref: -99 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.513642:0:10897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7200/0x135c87e8625d2af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.513660:0:10897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7200/0x135c87e8625d2af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.513675:0:10897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7200/0x135c87e8625d2af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096619.513913:0:10897:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 7680 00000004:00200000:2.0:1787096619.513918:0:10897:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787096619.514008:0:10897:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7200/0x135c87e8625d2af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.514037:0:10897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2aea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b27 expref: 15 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.514052:0:10897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7200/0x135c87e8625d2af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b27 expref: 14 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.514062:0:10897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9e4311271200) 00010000:00010000:2.0:1787096619.514066:0:10897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096619.514097:0:10897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e43110a7200, rc 0) 00000100:00100000:2.0:1787096619.514164:0:10897:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+14:40013:x1873906359164928:12345-192.168.202.38@tcp:101:rm.0 Request processed in 689us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096619.514172:0:10897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 285 00000100:00080000:2.0:1787096619.514195:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0F:1787096619.518135:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1787096619.518232:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359165056 00000100:00100000:0.0:1787096619.518250:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359165056 00000100:00100000:0.0:1787096619.518323:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 59 00000100:00100000:0.0:1787096619.518336:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4305651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+14:40013:x1873906359165056:12345-192.168.202.38@tcp:37:rm.0 00000100:00100000:0.0:1787096619.526185:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4305651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+14:40013:x1873906359165056:12345-192.168.202.38@tcp:37:rm.0 Request processed in 7748us (7959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096619.526201:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 59 00000100:00100000:0.0:1787096619.533674:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1787096619.533751:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359165184 00000100:00100000:2.0:1787096619.533764:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359165184 00000100:00100000:2.0:1787096619.533831:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 286 00000100:00100000:2.0:1787096619.533844:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+14:40013:x1873906359165184:12345-192.168.202.38@tcp:41:rm.0 00000004:00000024:2.0:1787096619.533919:0:5763:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7710179328 00000100:00100000:2.0:1787096619.534009:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+14:40013:x1873906359165184:12345-192.168.202.38@tcp:41:rm.0 Request processed in 168us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096619.534015:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 286 00000100:00100000:2.0:1787096619.536253:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0F:1787096619.536435:0:6569:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359165312 00000100:00100000:3.0:1787096619.536450:0:6569:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359165312 00000100:00100000:3.0:1787096619.536515:0:6569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 287 00000100:00100000:3.0:1787096619.536537:0:6569:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b80b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4291e33c-d1d3-4c99-86f3-ff81d311b61a+14:40013:x1873906359165312:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:3.0:1787096619.536571:0:6569:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096619.536598:0:6569:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0e00/0x135c87e8625d2af8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f02a84f880c8b2e expref: -99 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.536685:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.536704:0:6569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.536718:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.536736:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.536744:0:6569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.536751:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537263:0:6569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1000/0x135c87e8625d2b0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537274:0:6569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1000/0x135c87e8625d2b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537283:0:6569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1000/0x135c87e8625d2b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096619.537493:0:6569:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x21:0x0]: returning size 3145729 00000004:00200000:3.0:1787096619.537499:0:6569:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787096619.537636:0:6569:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1000/0x135c87e8625d2b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537652:0:6569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1000/0x135c87e8625d2b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537663:0:6569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537670:0:6569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537678:0:6569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537685:0:6569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f0c00 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096619.537689:0:6569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537698:0:6569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537713:0:6569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9e4311271200) 00010000:00010000:3.0:1787096619.537716:0:6569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096619.537722:0:6569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537729:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0c00/0x135c87e8625d2aff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537755:0:6569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537762:0:6569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537768:0:6569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537775:0:6569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f0800 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096619.537778:0:6569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537786:0:6569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537795:0:6569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0xc0870d27 (ffff9e4304ca5b00) 00010000:00010000:3.0:1787096619.537798:0:6569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096619.537801:0:6569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537808:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2b06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6569 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537848:0:6569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0e00/0x135c87e8625d2af8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b2e expref: 16 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537865:0:6569:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1000/0x135c87e8625d2b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b2e expref: 15 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.537887:0:6569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:3.0:1787096619.537890:0:6569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096619.537893:0:6569:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e43113f1000, rc 0) 00000100:00100000:3.0:1787096619.537979:0:6569:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b80b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4291e33c-d1d3-4c99-86f3-ff81d311b61a+15:40013:x1873906359165312:12345-192.168.202.38@tcp:101:rm.0 Request processed in 1453us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096619.537988:0:6569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 287 00000100:00100000:3.0:1787096619.540682:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1787096619.541134:0:5762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359165568 00000100:00100000:2.0:1787096619.541145:0:5762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359165568 00000100:00100000:2.0:1787096619.541210:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 288 00000100:00100000:2.0:1787096619.541222:0:5762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4336134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+15:40013:x1873906359165568:12345-192.168.202.38@tcp:36:rm.0 00010000:00010000:2.0:1787096619.541290:0:5762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787096619.541320:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1000/0x135c87e8625d2b0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b2e expref: 15 pid: 6569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541342:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:2.0:1787096619.541360:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7200/0x135c87e8625d2af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b27 expref: 14 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541369:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9e4311271200) 00010000:00010000:2.0:1787096619.541379:0:5762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096619.541400:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541415:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541424:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541439:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541446:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541452:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541832:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541841:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.541848:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787096619.543046:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8760 00000004:00080000:2.0:1787096619.543059:0:5762:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294190978106ns, next at 295190975363ns, rc = 0 00000040:00080000:2.0:1787096619.543128:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8824 00000004:00080000:2.0:1787096619.543135:0:5762:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 294191055047ns, next at 295191053931ns, rc = 0 00000040:00080000:2.0:1787096619.543152:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8824 00000040:00080000:2.0:1787096619.543174:0:5762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8888 00010000:00010000:2.0:1787096619.543248:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543262:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543271:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543280:0:5762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543288:0:5762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543295:0:5762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543324:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096619.543347:0:5762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543354:0:5762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543361:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.543368:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43110a6800 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:2.0:1787096619.543374:0:5762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.543379:0:5750:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096619.543383:0:5762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.543389:0:5750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.543420:0:5750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43110a7e00 already unused, calling callback (ffffffffc179e6f0) 00010000:00010000:3.0:1787096619.543425:0:5750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.543432:0:5750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.543445:0:5750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9e4316bc7c00) 00010000:00010000:3.0:1787096619.543448:0:5750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096619.543453:0:5750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.543460:0:5750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7e00/0x135c87e8625d2b29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.543474:0:5750:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096619.543476:0:5750:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096619.543478:0:5750:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096619.544609:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9e4316bc7c00) 00010000:00010000:2.0:1787096619.544614:0:5762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096619.544619:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.544626:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6800/0x135c87e8625d2b22 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.544648:0:5762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.544653:0:5762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.544657:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.544661:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43110a6c00 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:2.0:1787096619.544663:0:5762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.544667:0:5762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.544674:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9e4311271200) 00010000:00010000:2.0:1787096619.544675:0:5762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096619.544677:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.544680:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a6c00/0x135c87e8625d2b14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096619.544697:0:5762:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007372cbe8 reply state 000000003426fad8 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096619.544704:0:5762:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096619.544801:0:5762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4336134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+15:40013:x1873906359165568:12345-192.168.202.38@tcp:36:rm.0 Request processed in 3577us (4125us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1787096619.544810:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 288 00010000:00010000:3.0:1787096619.545878:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.545892:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.545900:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.545907:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43110a7400 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096619.545912:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.545920:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.545936:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0xc0870d27 (ffff9e4316bc7800) 00010000:00010000:3.0:1787096619.545939:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096619.545943:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096619.545950:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7400/0x135c87e8625d2b1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096619.546830:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1787096619.546902:0:5766:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359165824 00000100:00100000:1.0:1787096619.546913:0:5766:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359165824 00000100:00100000:1.0:1787096619.546972:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 60 00000100:00100000:1.0:1787096619.546983:0:5766:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4336135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+14:40013:x1873906359165824:12345-192.168.202.38@tcp:35:rm.0 00000100:00100000:1.0:1787096619.547300:0:5766:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4336135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+15:40013:x1873906359165824:12345-192.168.202.38@tcp:35:rm.0 Request processed in 318us (472us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787096619.547310:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 60 00000100:00100000:2.0:1787096619.548641:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1787096619.548679:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359166080 00000100:00100000:2.0:1787096619.548686:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359166080 00000100:00100000:2.0:1787096619.548735:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 289 00000100:00100000:2.0:1787096619.548744:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b80aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4291e33c-d1d3-4c99-86f3-ff81d311b61a+15:40013:x1873906359166080:12345-192.168.202.38@tcp:36:rm.0 00010000:00010000:2.0:1787096619.548799:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787096619.548825:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43059f3e00/0x135c87e8625d27d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8a55 expref: 15 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.548847:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43059f3a00/0x135c87e8625d272b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8a24 expref: 14 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.548872:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9e4311271200) 00010000:00010000:2.0:1787096619.548892:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43059f2e00/0x135c87e8625d270f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8a1d expref: 13 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.548902:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e4311271700) 00010000:00010000:2.0:1787096619.548908:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096619.548942:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.548961:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.548969:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.548979:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.548984:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.548988:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.549661:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.549669:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.549675:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096619.550395:0:5764:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 7680 00010000:00010000:2.0:1787096619.550415:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550423:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550430:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550443:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43110a7000 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:2.0:1787096619.550448:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550457:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550480:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9e4316bc7b00) 00010000:00010000:2.0:1787096619.550483:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096619.550487:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550492:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7000/0x135c87e8625d2b3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550513:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550516:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550520:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550524:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43110a7a00 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:2.0:1787096619.550525:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550529:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550571:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e4316bc7700) 00010000:00010000:2.0:1787096619.550574:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096619.550578:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.550585:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7a00/0x135c87e8625d2b30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096619.550598:0:5764:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002517d050 reply state 00000000673d4248 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096619.550605:0:5764:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096619.550693:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b80aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4291e33c-d1d3-4c99-86f3-ff81d311b61a+14:40013:x1873906359166080:12345-192.168.202.38@tcp:36:rm.0 Request processed in 1947us (2054us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787096619.550703:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 289 00010000:00010000:1.0:1787096619.551745:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096619.551759:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096619.551766:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096619.551772:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43110a7800 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:1.0:1787096619.551775:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096619.551782:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096619.551795:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffff9e4316bc7100) 00010000:00010000:1.0:1787096619.551798:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096619.551803:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096619.551808:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43110a7800/0x135c87e8625d2b37 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096619.913181:0:5751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096620.937261:0:6560:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096621.960208:0:8267:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096622.451961:0:31422:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 19:43:42 (1787096622) 00000100:00100000:0.0:1787096622.792214:0:3298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4305651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1873906366490624:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1787096622.792226:0:7976:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297440144409ns, next at 298440141727ns, rc = 0 00000004:00080000:2.0:1787096622.792242:0:6769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 297440161109ns, next at 298440158150ns, rc = 0 00000100:00100000:0.0:1787096622.792292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096622.792360:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4305650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873906366491008:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.792398:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096622.792448:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4307f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1873906366491520:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.792474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096622.792503:0:3298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4305650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1873906366491136:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.792515:0:3299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e433b80b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366490752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096622.792547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096622.792564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096622.792598:0:3299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4307f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366491264:0@lo:400:kworker.0 00000100:00100000:0.0:1787096622.792602:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366491008 00000100:00100000:0.0:1787096622.792610:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366491008 00000100:00100000:2.0:1787096622.792637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096622.792654:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366491136 00000100:00100000:0.0:1787096622.792658:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366491136 00000100:00100000:2.0:1787096622.792675:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787096622.792683:0:3299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4305652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab81508b-bb80-40b3-9204-4e002fcdebb6:3299:1873906366490880:0@lo:400:kworker.0 00000100:00100000:0.0:1787096622.792699:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787096622.792711:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873906366491008:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787096622.792738:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096622.792757:0:10897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787096622.792759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096622.792768:0:10897:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873906366491136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.792796:0:3299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4307f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1873906366491392:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.792831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096622.792842:0:10897:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873906366491136:12345-0@lo:400:kworker.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096622.792850:0:10897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787096622.792871:0:10897:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366491392 00000100:00100000:0.0:1787096622.792881:0:10897:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366491392 00000100:00100000:0.0:1787096622.792913:0:5755:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366490880 00000100:00100000:0.0:1787096622.792917:0:5755:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366490880 00000100:00100000:0.0:1787096622.792949:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787096622.792958:0:5755:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4311054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab81508b-bb80-40b3-9204-4e002fcdebb6+18:3299:x1873906366490880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096622.792995:0:5755:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4311054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab81508b-bb80-40b3-9204-4e002fcdebb6+18:3299:x1873906366490880:12345-0@lo:400:kworker.0 Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096622.793002:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787096622.793059:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873906366491008:12345-0@lo:400:kworker.0 Request processed in 352us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096622.793063:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787096622.793099:0:6548:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366490624 00000100:00100000:2.0:1787096622.793104:0:6548:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366490624 00000100:00100000:0.0:1787096622.793112:0:10897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787096622.793118:0:10897:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873906366491392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.793141:0:6548:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366490752 00000100:00100000:0.0:1787096622.793144:0:10897:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b80b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873906366491392:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096622.793145:0:6548:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366490752 00000100:00100000:0.0:1787096622.793153:0:10897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1787096622.793170:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787096622.793174:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787096622.793177:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096622.793210:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787096622.793212:0:3298:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4305650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1873906366491136:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.793221:0:6548:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3298:x1873906366490624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787096622.793247:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096622.793281:0:6548:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3298:x1873906366490624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096622.793288:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787096622.793304:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787096622.793311:0:6548:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b80ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3299:x1873906366490752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096622.793331:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096622.793363:0:6548:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b80ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3299:x1873906366490752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096622.793369:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787096622.793392:0:6545:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366491520 00000100:00100000:2.0:1787096622.793396:0:6545:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366491520 00000100:00100000:0.0:1787096622.793419:0:3298:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4305651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1873906366490624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096622.793429:0:6545:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366491264 00000100:00100000:2.0:1787096622.793433:0:6545:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366491264 00000100:00100000:2.0:1787096622.793459:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787096622.793461:0:3299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4305652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab81508b-bb80-40b3-9204-4e002fcdebb6:3299:1873906366490880:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.793471:0:6545:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3297:x1873906366491520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096622.793479:0:3299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4307f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1873906366491392:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.793534:0:6545:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3297:x1873906366491520:12345-0@lo:400:kworker.0 Request processed in 52us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096622.793542:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787096622.793559:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787096622.793568:0:6545:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3299:x1873906366491264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.793607:0:6545:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3299:x1873906366491264:12345-0@lo:400:kworker.0 Request processed in 41us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096622.793614:0:3299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e433b80b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366490752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096622.793615:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787096622.793636:0:3299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4307f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366491264:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.794056:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4305650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873906366491008:0@lo:400:kworker.0 00000100:00100000:2.0:1787096622.794067:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4307f16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1873906366491520:0@lo:400:kworker.0 00000004:00080000:2.0:1787096622.812287:0:5784:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:2.0:1787096622.812316:0:5784:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000004:00080000:2.0:1787096622.812332:0:5784:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:2.0:1787096622.812343:0:5784:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:2.0:1787096622.812350:0:5784:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1787096622.812354:0:5784:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:1.0:1787096622.812473:0:3298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4307f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1873906366491648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787096622.812557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096622.812587:0:6543:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366491648 00000100:00100000:2.0:1787096622.812595:0:6543:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366491648 00000001:00080000:3.0:1787096622.812615:0:6571:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1787096622.812624:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096622.812633:0:3298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1873906366492032:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787096622.812637:0:6571:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:2.0:1787096622.812653:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787096622.812660:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096622.812668:0:6543:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3298:x1873906366491648:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787096622.812670:0:6545:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366492032 00000100:00100000:0.0:1787096622.812676:0:6545:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366492032 00002000:00080000:2.0:1787096622.812695:0:6543:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00100000:1.0:1787096622.812695:0:3299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4307f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366491776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787096622.812716:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787096622.812722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096622.812729:0:6545:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1873906366492032:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1787096622.812731:0:6543:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 524288, mtime: 0x6a84ee29, atime: 0x6a84ee29, ctime: 0x6a84ee29, blocks: 0x403 00010000:00010000:2.0:1787096622.812741:0:6543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096622.812743:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00080000:0.0:1787096622.812746:0:6545:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:1.0:1787096622.812753:0:3299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366491904:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787096622.812755:0:6544:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366491776 00000100:00100000:3.0:1787096622.812762:0:6544:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366491776 00010000:00010000:2.0:1787096622.812763:0:6543:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1787096622.812767:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.812773:0:6543:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1787096622.812781:0:6543:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096622.812781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787096622.812791:0:6545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000daa81480/0x135c87e8625d2a11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8ae1 expref: 5 pid: 7970 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096622.812797:0:6544:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366491904 00010000:00010000:0.0:1787096622.812800:0:6545:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1787096622.812802:0:6543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096622.812803:0:6545:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1787096622.812809:0:6544:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366491904 00010000:00010000:0.0:1787096622.812810:0:6545:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.812816:0:6543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096622.812817:0:7970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787096622.812830:0:7970:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3299:x1873906366491776:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787096622.812839:0:6543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787096622.812846:0:7970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787096622.812850:0:6545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000daa81480/0x135c87e8625d2a11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8ae1 expref: 5 pid: 7970 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.812859:0:6543:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787096622.812861:0:7970:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787096622.812866:0:6545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000daa81480/0x135c87e8625d2a11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8ae1 expref: 5 pid: 7970 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.812868:0:7970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096622.812875:0:5750:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096622.812885:0:5750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.812888:0:7970:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1787096622.812892:0:7970:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1787096622.812896:0:7970:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096622.812898:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e433b868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6545:1873906366492160:192.168.202.38@tcp:104: 00010000:00010000:3.0:1787096622.812906:0:5750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43110a6c00 already unused, calling callback (ffffffffc179e6f0) 00010000:00010000:3.0:1787096622.812914:0:5750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.812915:0:7970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096622.812934:0:5750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.812942:0:7970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.812948:0:7970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096622.812956:0:5750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.812960:0:7970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787096622.812968:0:5750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc93cb3c/0x135c87e8625d2b45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096622.812969:0:6545:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e43029d83c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787096622.812993:0:5750:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096622.812997:0:5750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096622.813004:0:5750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43059f2a00 already unused, calling callback (ffffffffc179e6f0) 00010000:00010000:3.0:1787096622.813007:0:5750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096622.813014:0:5750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096622.813032:0:5750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096622.813040:0:5750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000589a41b0/0x135c87e8625d2b53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096622.813063:0:5750:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096622.813066:0:5750:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096622.813070:0:5750:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096622.813126:0:5751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096622.813547:0:7970:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3299:x1873906366491776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 719us (825us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787096622.813557:0:7970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787096622.813580:0:7970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787096622.813591:0:7970:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1873906366491904:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787096622.813592:0:6543:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3298:x1873906366491648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 927us (1031us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787096622.813604:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00002000:00080000:1.0:1787096622.813607:0:7970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1787096622.813625:0:7970:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 3145728, mtime: 0x6a84ee29, atime: 0x0, ctime: 0x6a84ee29, blocks: 0x807 00010000:00010000:1.0:1787096622.813632:0:7970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.813641:0:7970:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1787096622.813643:0:7970:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1787096622.813646:0:7970:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.813654:0:7970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.813668:0:7970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.813673:0:7970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096622.813688:0:7970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096622.813805:0:6560:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096622.813812:0:6560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.813826:0:6560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43059f3000 already unused, calling callback (ffffffffc179e6f0) 00010000:00010000:2.0:1787096622.813830:0:6560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.813839:0:6560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.813868:0:6560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.813876:0:6560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003da1c3e/0x135c87e8625d2b5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.813901:0:6560:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096622.813904:0:6560:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096622.813908:0:6560:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096622.814157:0:7970:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1873906366491904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 570us (1377us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787096622.814164:0:7970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787096622.814203:0:3299:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787096622.814208:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e431109ce00, transno 4294967304 00000004:00080000:1.0:1787096622.814222:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e4336136680, transno 4294967305 00000004:00080000:1.0:1787096622.814226:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e4336137100, transno 4294967306 00000100:00100000:1.0:1787096622.814232:0:3299:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9e4336135880 x1873906366491904/t4294967308(4294967308) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787096638 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787096622.814244:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e4336135880/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787096622.814249:0:3299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366491904:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787096622.814263:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e4307f15f80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787096622.814267:0:3299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4307f15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366491776:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1787096622.814295:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e4307f16680/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787096622.814299:0:3298:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4307f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1873906366491648:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787096622.814479:0:6768:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 3 done 00000100:00100000:2.0:1787096622.814680:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1787096622.814707:0:5749:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359166208 00000100:00100000:2.0:1787096622.814712:0:5749:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359166208 00010000:00010000:2.0:1787096622.814744:0:5749:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000daa81480/0x135c87e8625d2a11 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8ae1 expref: 6 pid: 7970 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096622.814771:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 62 00000100:00100000:2.0:1787096622.814779:0:5749:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b809180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4291e33c-d1d3-4c99-86f3-ff81d311b61a+6:2367:x1873906359166208:12345-192.168.202.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096622.814789:0:5749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096622.814794:0:5749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000daa81480/0x135c87e8625d2a11 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8ae1 expref: 6 pid: 7970 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.814806:0:5749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000daa81480/0x135c87e8625d2a11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8ae1 expref: 6 pid: 7970 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.814831:0:5749:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1787096622.814833:0:5749:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1787096622.814836:0:5749:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.814843:0:5749:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.814858:0:5749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096622.814895:0:5749:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b809180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4291e33c-d1d3-4c99-86f3-ff81d311b61a+6:2367:x1873906359166208:12345-192.168.202.38@tcp:103:ldlm_bl.0 Request processed in 116us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096622.814902:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 62 00000100:00080000:2.0:1787096622.814925:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787096622.814995:0:6545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daa81480/0x135c87e8625d2a11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8ae1 expref: 5 pid: 7970 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096622.815018:0:6545:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e433b868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6545:1873906366492160:192.168.202.38@tcp:104: 00010000:00010000:0.0:1787096622.815030:0:6545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096622.815039:0:6545:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096622.815047:0:6545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096622.815055:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096622.815061:0:6545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096622.815111:0:6545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1787096622.815497:0:7433:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787096622.815508:0:7433:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1787096622.815544:0:7433:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787096622.815590:0:6545:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1873906366492032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2865us (2929us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787096622.815599:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:1.0:1787096622.815603:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e4336136d80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787096622.815610:0:3298:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1873906366492032:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787096622.815668:0:8267:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096622.815673:0:8267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.815681:0:8267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e4205882800 already unused, calling callback (ffffffffc179e6f0) 00010000:00010000:2.0:1787096622.815685:0:8267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.815693:0:8267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.815705:0:8267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.815724:0:8267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c31346a9/0x135c87e8625d2b4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096622.815741:0:8267:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096622.815742:0:8267:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096622.815744:0:8267:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096622.887955:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1787096622.887998:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1787096622.888036:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1787096622.888068:0:10897:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359166464 00000100:00100000:2.0:1787096622.888098:0:10897:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359166464 00000100:00100000:3.0:1787096622.888105:0:6544:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359166592 00000100:00100000:3.0:1787096622.888112:0:6544:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359166592 00000100:00100000:1.0:1787096622.888136:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359166336 00000100:00100000:1.0:1787096622.888142:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359166336 00000100:00100000:3.0:1787096622.888172:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 78 00000100:00100000:2.0:1787096622.888172:0:10897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 165 00000100:00100000:1.0:1787096622.888194:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 270 00000100:00100000:3.0:1787096622.888195:0:6544:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b80b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2368:x1873906359166592:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:2.0:1787096622.888195:0:10897:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2368:x1873906359166464:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1787096622.888208:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4311055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77b98eb1-7dd9-4002-a8b9-f473c9401462+9:2368:x1873906359166336:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1787096622.888340:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4311055050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77b98eb1-7dd9-4002-a8b9-f473c9401462+9:2368:x1873906359166336:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 136us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096622.888342:0:6544:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b80b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2368:x1873906359166592:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 156us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096622.888356:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 78 00000100:00100000:1.0:1787096622.888362:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 270 00000100:00080000:3.0:1787096622.888401:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787096622.888406:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096622.889470:0:10897:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2368:x1873906359166464:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 1284us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096622.889479:0:10897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 165 00010000:00010000:3.0:1787096622.985306:0:5750:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096622.994754:0:31473:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27b needs >= 8 OSTs 00000001:02000400:0.0:1787096623.587508:0:31521:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27c: test creating with n+2 OSTs ======= 19:43:43 (1787096623) 00010000:00010000:0.0:1787096624.008201:0:5751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096624.091098:0:31569:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27c needs >= 8 OSTs 00000001:02000400:1.0:1787096624.662892:0:31617:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 19:43:44 (1787096624) 00010000:00010000:2.0:1787096625.032327:0:6560:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096625.236106:0:31665:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27d needs >= 8 OSTs 00000001:02000400:3.0:1787096625.817908:0:31713:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 19:43:45 (1787096625) 00010000:00010000:2.0:1787096626.056294:0:8267:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096626.344769:0:31761:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27e needs >= 8 OSTs 00000001:02000400:0.0:1787096626.923497:0:31809:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 19:43:46 (1787096626) 00010000:00010000:3.0:1787096627.080368:0:5750:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096627.425883:0:31857:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27f needs >= 8 OSTs 00000100:00100000:0.0:1787096627.912245:0:3298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab81508b-bb80-40b3-9204-4e002fcdebb6:3298:1873906366492288:0@lo:400:kworker.0 00000100:00100000:1.0:1787096627.912251:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873906366492672:0@lo:400:kworker.0 00000100:00100000:0.0:1787096627.912328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096627.912335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096627.912358:0:3299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e433b868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366492416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096627.912404:0:3300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1873906366493056:0@lo:400:kworker.0 00000100:00100000:0.0:1787096627.912405:0:3298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1873906366492800:0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.912416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096627.912435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096627.912448:0:3299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366492928:0@lo:400:kworker.0 00000100:00100000:0.0:1787096627.912458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096627.912485:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4307f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1873906366492544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096627.912495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096627.912518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096627.912530:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366492672 00000100:00100000:3.0:1787096627.912539:0:6548:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366492416 00000100:00100000:2.0:1787096627.912539:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366492672 00000100:00100000:1.0:1787096627.912542:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1873906366493184:0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.912545:0:6548:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366492416 00000100:00100000:1.0:1787096627.912563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096627.912600:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366493056 00000100:00100000:3.0:1787096627.912602:0:6548:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366492544 00000100:00100000:2.0:1787096627.912604:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366493056 00000100:00100000:3.0:1787096627.912606:0:6548:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366492544 00000100:00100000:1.0:1787096627.912610:0:5762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366492800 00000100:00100000:0.0:1787096627.912611:0:5756:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366492288 00000100:00100000:1.0:1787096627.912615:0:5762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366492800 00000100:00100000:0.0:1787096627.912617:0:5756:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366492288 00000100:00100000:2.0:1787096627.912645:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787096627.912648:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787096627.912654:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787096627.912661:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873906366492672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.912662:0:6548:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4336134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1873906366492416:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096627.912665:0:5762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873906366493056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096627.912669:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787096627.912681:0:5756:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4311056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab81508b-bb80-40b3-9204-4e002fcdebb6+18:3298:x1873906366492288:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787096627.912706:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1787096627.912733:0:5756:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4311056050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab81508b-bb80-40b3-9204-4e002fcdebb6+18:3298:x1873906366492288:12345-0@lo:400:kworker.0 Request processed in 53us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096627.912736:0:5762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873906366493056:12345-0@lo:400:kworker.0 Request processed in 75us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096627.912739:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873906366492672:12345-0@lo:400:kworker.0 Request processed in 84us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096627.912748:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787096627.912754:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787096627.912755:0:6548:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4336134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1873906366492416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096627.912764:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787096627.912766:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787096627.912778:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787096627.912789:0:5762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873906366492800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.912798:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787096627.912808:0:6548:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1873906366492544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096627.912828:0:3298:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab81508b-bb80-40b3-9204-4e002fcdebb6:3298:1873906366492288:0@lo:400:kworker.0 00002000:00000024:3.0:1787096627.912833:0:6548:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096627.912835:0:5762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1873906366492800:12345-0@lo:400:kworker.0 Request processed in 48us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096627.912844:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787096627.912867:0:3298:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1873906366492800:0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.912882:0:6548:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1873906366492544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096627.912882:0:7970:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366492928 00000100:00100000:1.0:1787096627.912888:0:7970:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366492928 00000100:00100000:3.0:1787096627.912892:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787096627.912927:0:6543:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906366493184 00000100:00100000:3.0:1787096627.912931:0:6543:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906366493184 00000100:00100000:1.0:1787096627.912934:0:7970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787096627.912945:0:7970:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4336134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1873906366492928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.912967:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787096627.912977:0:6543:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3297:x1873906366493184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096627.912992:0:7970:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4336134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1873906366492928:12345-0@lo:400:kworker.0 Request processed in 49us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096627.913002:0:7970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787096627.913027:0:6543:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3297:x1873906366493184:12345-0@lo:400:kworker.0 Request processed in 43us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096627.913035:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787096627.913045:0:3297:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787096627.913052:0:3297:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e43180d1c00, transno 4294967302 00000100:00080000:3.0:1787096627.913064:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787096627.913066:0:3297:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e4336134a80, transno 4294967304 00000100:00080000:3.0:1787096627.913071:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1787096627.913073:0:3297:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e4305651c00, transno 4294967305 00000100:00080000:3.0:1787096627.913076:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787096627.913104:0:3297:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e4305650a80, transno 4294967306 00000100:00100000:1.0:1787096627.913116:0:3297:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9e4307f15f80 x1873906366491776/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787096638 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096627.913135:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4307f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1873906366492544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096627.913153:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1873906366493184:0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.913172:0:3299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366492928:0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.913200:0:3299:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e433b868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1873906366492416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096627.913352:0:3300:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1873906366493056:0@lo:400:kworker.0 00000100:00100000:3.0:1787096627.913368:0:3300:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873906366492672:0@lo:400:kworker.0 00000004:00080000:1.0:1787096627.913604:0:7975:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 0 in flight, 4 done 00000001:00080000:3.0:1787096627.928039:0:6571:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787096627.931184:0:7433:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1787096627.931198:0:7433:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:02000400:2.0:1787096628.004710:0:31911:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 19:43:47 (1787096627) 00000100:00100000:1.0:1787096628.004942:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1787096628.004988:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1787096628.005031:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1787096628.005049:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359166848 00000100:00100000:1.0:1787096628.005055:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1787096628.005063:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359166848 00000100:00100000:1.0:1787096628.005075:0:5755:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359166720 00000100:00100000:1.0:1787096628.005105:0:5755:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359166720 00000100:00100000:1.0:1787096628.005159:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 272 00000100:00100000:0.0:1787096628.005162:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 169 00000100:00100000:1.0:1787096628.005171:0:5755:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4311057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77b98eb1-7dd9-4002-a8b9-f473c9401462+9:2365:x1873906359166720:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1787096628.005177:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2365:x1873906359166848:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1787096628.005253:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2365:x1873906359166848:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 82us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096628.005260:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 169 00000100:00100000:3.0:1787096628.005277:0:10909:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359166976 00000100:00100000:3.0:1787096628.005281:0:10909:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359166976 00000100:00100000:0.0:1787096628.005305:0:7970:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359167104 00000100:00100000:0.0:1787096628.005308:0:7970:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359167104 00000100:00100000:3.0:1787096628.005316:0:10909:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 81 00000100:00100000:3.0:1787096628.005324:0:10909:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2366:x1873906359166976:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1787096628.005347:0:7970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 82 00000100:00100000:0.0:1787096628.005356:0:7970:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2366:x1873906359167104:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1787096628.005372:0:5755:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4311057050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77b98eb1-7dd9-4002-a8b9-f473c9401462+9:2365:x1873906359166720:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 204us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096628.005378:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 272 00000100:00100000:0.0:1787096628.005404:0:7970:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2366:x1873906359167104:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 49us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096628.005410:0:7970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 82 00000100:00080000:0.0:1787096628.005441:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787096628.005446:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787096628.005448:0:5758:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096628.005574:0:10909:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:2366:x1873906359166976:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 250us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096628.005592:0:10909:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 81 00000100:00100000:1.0:1787096628.050064:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1787096628.050151:0:5762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359167232 00000100:00100000:3.0:1787096628.050162:0:5762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359167232 00000100:00100000:3.0:1787096628.050222:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 290 00000100:00100000:3.0:1787096628.050241:0:5762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+5:41772:x1873906359167232:12345-192.168.202.38@tcp:101:mkdir.0 00010000:00010000:3.0:1787096628.050266:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096628.050293:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f02a84f880c8b35 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.050369:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.050407:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.050423:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096628.050657:0:5762:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787096628.050662:0:5762:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787096628.050780:0:5762:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.050808:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b35 expref: 7 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.050826:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b35 expref: 6 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.050836:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:3.0:1787096628.050840:0:5762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096628.050844:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e43113f0000, rc 0) 00000100:00100000:3.0:1787096628.050908:0:5762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+6:41772:x1873906359167232:12345-192.168.202.38@tcp:101:mkdir.0 Request processed in 669us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096628.050916:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 290 00000100:00100000:2.0:1787096628.052168:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1787096628.052200:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359167488 00000100:00100000:3.0:1787096628.052205:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359167488 00000100:00100000:3.0:1787096628.052248:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 291 00000100:00100000:3.0:1787096628.052256:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e433b809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+6:41772:x1873906359167488:12345-192.168.202.38@tcp:36:mkdir.0 00010000:00010000:3.0:1787096628.052294:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096628.052316:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b35 expref: 6 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.052327:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:3.0:1787096628.052338:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096628.052583:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.052594:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.052604:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.052621:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.052629:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.052637:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096628.054122:0:5763:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23:0x0]: returning size 512 00010000:00010000:3.0:1787096628.054137:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.054147:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.054155:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.054172:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f1800 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096628.054177:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.054186:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.054198:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e4304ca5b00) 00010000:00010000:3.0:1787096628.054202:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096628.054207:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.054214:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096628.054235:0:5763:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c4405877 reply state 000000003b5036c2 transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096628.054244:0:5763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787096628.054327:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e433b809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+7:41772:x1873906359167488:12345-192.168.202.38@tcp:36:mkdir.0 Request processed in 2069us (2160us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1787096628.054336:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 291 00010000:00010000:1.0:1787096628.055002:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.055013:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.055021:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.055027:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f1400 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:1.0:1787096628.055031:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.055038:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.055049:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff9e4304ca5800) 00010000:00010000:1.0:1787096628.055052:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096628.055061:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.055067:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1400/0x135c87e8625d2b76 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096628.065374:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1787096628.065424:0:10897:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359167616 00000100:00100000:0.0:1787096628.065437:0:10897:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359167616 00000100:00100000:0.0:1787096628.065526:0:10897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 292 00000100:00100000:0.0:1787096628.065541:0:10897:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e43346c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+6:41775:x1873906359167616:12345-192.168.202.38@tcp:101:lfs.0 00010000:00010000:0.0:1787096628.065572:0:10897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096628.065601:0:10897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205882200/0x135c87e8625d2b7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f02a84f880c8b3c expref: -99 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.065686:0:10897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883a00/0x135c87e8625d2b84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.065700:0:10897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883a00/0x135c87e8625d2b84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.065711:0:10897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883a00/0x135c87e8625d2b84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096628.065777:0:10897:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787096628.065780:0:10897:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096628.065815:0:10897:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883a00/0x135c87e8625d2b84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.065844:0:10897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205882200/0x135c87e8625d2b7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b3c expref: 8 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.065875:0:10897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883a00/0x135c87e8625d2b84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b3c expref: 7 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.065883:0:10897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e4303914600) 00010000:00010000:0.0:1787096628.065885:0:10897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096628.065889:0:10897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e4205883a00, rc 0) 00000100:00100000:0.0:1787096628.065957:0:10897:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e43346c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+7:41775:x1873906359167616:12345-192.168.202.38@tcp:101:lfs.0 Request processed in 421us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096628.065965:0:10897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 292 00000100:00100000:1.0:1787096628.066951:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1787096628.066988:0:5762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359167744 00000100:00100000:3.0:1787096628.066993:0:5762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359167744 00000100:00100000:3.0:1787096628.067024:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 293 00000100:00100000:3.0:1787096628.067029:0:5762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e4307f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+7:41775:x1873906359167744:12345-192.168.202.38@tcp:101:lfs.0 00010000:00010000:3.0:1787096628.067040:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096628.067049:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f02a84f880c8b43 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067110:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067119:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067126:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067138:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067143:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067148:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067230:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1600/0x135c87e8625d2ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067235:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1600/0x135c87e8625d2ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067239:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1600/0x135c87e8625d2ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096628.067256:0:5762:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23:0x0]: returning size 512 00000004:00200000:3.0:1787096628.067258:0:5762:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787096628.067268:0:5762:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1600/0x135c87e8625d2ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067286:0:5762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067291:0:5762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067296:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067299:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f0000 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096628.067303:0:5762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067308:0:5762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067316:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e4303914600) 00010000:00010000:3.0:1787096628.067318:0:5762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096628.067321:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067325:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0000/0x135c87e8625d2b92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067341:0:5762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067345:0:5762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067348:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067356:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f1c00 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096628.067357:0:5762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067361:0:5762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067365:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff9e4304ca5b00) 00010000:00010000:3.0:1787096628.067366:0:5762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096628.067368:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067371:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1c00/0x135c87e8625d2b99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067392:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1800/0x135c87e8625d2b8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b43 expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067399:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1600/0x135c87e8625d2ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b43 expref: 8 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.067405:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:3.0:1787096628.067406:0:5762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787096628.067408:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e43113f1600, rc 0) 00000100:00100000:3.0:1787096628.067441:0:5762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e4307f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+8:41775:x1873906359167744:12345-192.168.202.38@tcp:101:lfs.0 Request processed in 412us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096628.067445:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 293 00000100:00100000:2.0:1787096628.068594:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1787096628.068635:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359167872 00000100:00100000:3.0:1787096628.068650:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359167872 00000100:00100000:3.0:1787096628.068692:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 294 00000100:00100000:3.0:1787096628.068702:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e43346c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+8:41775:x1873906359167872:12345-192.168.202.38@tcp:101:lfs.0 00010000:00010000:3.0:1787096628.068714:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096628.068727:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1e00/0x135c87e8625d2ba7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f02a84f880c8b4a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068774:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068785:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068795:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068808:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068816:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068823:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068880:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068888:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068894:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068905:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f1200 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096628.068909:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068915:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068925:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:3.0:1787096628.068927:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096628.068930:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068936:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1200/0x135c87e8625d2bae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068944:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068950:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068956:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068961:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f0800 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096628.068963:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068968:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068983:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0xe0be4298 (ffff9e4304ca5f00) 00010000:00010000:3.0:1787096628.068985:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096628.068988:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.068993:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2bb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.069024:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1e00/0x135c87e8625d2ba7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b4a expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.069034:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:3.0:1787096628.069036:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096628.069040:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1e00/0x135c87e8625d2ba7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b4a expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.069048:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e43113f1e00, rc 0) 00000100:00100000:3.0:1787096628.069107:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e43346c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4291e33c-d1d3-4c99-86f3-ff81d311b61a+8:41775:x1873906359167872:12345-192.168.202.38@tcp:101:lfs.0 Request processed in 407us (514us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096628.069115:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 294 00000100:00100000:2.0:1787096628.070228:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1787096628.070267:0:10897:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359168128 00000100:00100000:0.0:1787096628.070273:0:10897:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359168128 00000100:00100000:0.0:1787096628.070317:0:10897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 295 00000100:00100000:0.0:1787096628.070330:0:10897:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e43346c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+8:41775:x1873906359168128:12345-192.168.202.38@tcp:101:lfs.0 00010000:00010000:0.0:1787096628.070342:0:10897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096628.070354:0:10897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205882200/0x135c87e8625d2bbc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f02a84f880c8b51 expref: -99 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.070456:0:10897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.070481:0:10897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.070492:0:10897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.070507:0:10897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.070524:0:10897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.070531:0:10897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071321:0:10897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071338:0:10897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071348:0:10897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096628.071366:0:10897:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 0 00010000:00010000:0.0:1787096628.071411:0:10897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071419:0:10897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071427:0:10897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071433:0:10897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e4205883600 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:0.0:1787096628.071437:0:10897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071445:0:10897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071483:0:10897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:0.0:1787096628.071485:0:10897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096628.071489:0:10897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071493:0:10897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883600/0x135c87e8625d2bc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096628.071506:0:10897:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000012853e4b reply state 00000000cb9cd29c transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096628.071512:0:10897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096628.071544:0:10897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205882200/0x135c87e8625d2bbc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 11 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071553:0:10897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 10 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.071558:0:10897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9e4303914700) 00010000:00010000:0.0:1787096628.071559:0:10897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096628.071561:0:10897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e4205883000, rc 0) 00000100:00100000:0.0:1787096628.071631:0:10897:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e43346c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+11:41775:x1873906359168128:12345-192.168.202.38@tcp:101:lfs.0 Request processed in 1305us (1405us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787096628.071639:0:10897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 295 00010000:00010000:0.0:1787096628.072297:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.072306:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.072319:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.072325:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e4205883400 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:0.0:1787096628.072328:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.072334:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.072342:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0xe0be4298 (ffff9e4303914f00) 00010000:00010000:0.0:1787096628.072344:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096628.072348:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096628.072353:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883400/0x135c87e8625d2bca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096628.073043:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1787096628.073137:0:5762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359168384 00000100:00100000:3.0:1787096628.073145:0:5762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359168384 00000100:00100000:3.0:1787096628.073191:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 296 00000100:00100000:3.0:1787096628.073202:0:5762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e43346c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+10:41775:x1873906359168384:12345-192.168.202.38@tcp:101:lfs.0 00010000:00010000:3.0:1787096628.073234:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096628.073248:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1e00/0x135c87e8625d2bdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f02a84f880c8b58 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.073357:0:5762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.073371:0:5762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 11 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.073380:0:5762:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.073419:0:5762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 11 pid: 10897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.073433:0:5762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 11 pid: 10897 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096628.073448:0:5762:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9e4336136680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5762:1873906366493312:192.168.202.38@tcp:104: 00000100:00100000:3.0:1787096628.073560:0:5762:0:(client.c:2692:ptlrpc_set_wait()) set ffff9e4311639cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096628.074320:0:5762:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9e4336136680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5762:1873906366493312:192.168.202.38@tcp:104: 00010000:00010000:3.0:1787096628.074340:0:5762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096628.074602:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1787096628.074658:0:8217:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359168512 00000100:00100000:1.0:1787096628.074664:0:8217:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359168512 00010000:00010000:1.0:1787096628.074693:0:8217:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 12 pid: 10897 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096628.074723:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 63 00000100:00100000:1.0:1787096628.074730:0:8217:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e43346c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+12:2367:x1873906359168512:12345-192.168.202.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096628.074738:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096628.074743:0:8217:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 12 pid: 10897 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.074754:0:8217:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 12 pid: 10897 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.074781:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e4205883000/0x135c87e8625d2bd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b51 expref: 12 pid: 10897 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.074797:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9e4303914700) 00010000:00010000:1.0:1787096628.074802:0:8217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.074808:0:8217:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.074828:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096628.074855:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096628.074891:0:5762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096628.074896:0:8217:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e43346c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4291e33c-d1d3-4c99-86f3-ff81d311b61a+11:2367:x1873906359168512:12345-192.168.202.38@tcp:103:ldlm_bl.0 Request processed in 164us (293us total) trans 0 rc 0/0 00010000:00010000:3.0:1787096628.074909:0:5762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096628.074914:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 63 00000004:00200000:3.0:1787096628.074931:0:5762:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 0 00010000:00010000:3.0:1787096628.075298:0:5762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075308:0:5762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075315:0:5762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075321:0:5762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e43113f0800 already unused, calling callback (ffffffffc21e44f0) 00010000:00010000:3.0:1787096628.075325:0:5762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075334:0:5762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075343:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9e4303914700) 00010000:00010000:3.0:1787096628.075346:0:5762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787096628.075350:0:5762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075357:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f0800/0x135c87e8625d2be6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075398:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1e00/0x135c87e8625d2bdf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b58 expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075409:0:5762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9e4304ca5000) 00010000:00010000:3.0:1787096628.075411:0:5762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096628.075415:0:5762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e43113f1e00/0x135c87e8625d2bdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.38@tcp remote: 0x4f02a84f880c8b58 expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096628.075436:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e43113f1e00, rc 0) 00000100:00100000:3.0:1787096628.075479:0:5762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e43346c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4291e33c-d1d3-4c99-86f3-ff81d311b61a+9:41775:x1873906359168384:12345-192.168.202.38@tcp:101:lfs.0 Request processed in 2269us (2429us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096628.075487:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 296 00000100:00100000:2.0:1787096628.076398:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1787096628.076438:0:11276:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906359168768 00000100:00100000:1.0:1787096628.076442:0:11276:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906359168768 00000100:00100000:1.0:1787096628.076489:0:11276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 61 00000100:00100000:1.0:1787096628.076498:0:11276:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9e43346c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4291e33c-d1d3-4c99-86f3-ff81d311b61a+9:41775:x1873906359168768:12345-192.168.202.38@tcp:35:lfs.0 00000100:00100000:1.0:1787096628.076649:0:11276:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9e43346c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4291e33c-d1d3-4c99-86f3-ff81d311b61a+10:41775:x1873906359168768:12345-192.168.202.38@tcp:35:lfs.0 Request processed in 153us (252us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787096628.076658:0:11276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 61 00010000:00010000:0.0:1787096628.104283:0:5751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096628.577711:0:31960:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_28a: @@@@@@ FAIL: setstripe failed Debug log: 903 lines, 903 kept, 0 dropped, 0 bad.