00000100:00100000:0.0F:1782107581.504356:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472508288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107581.504423:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1782107581.504918:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472508288 00000100:00100000:3.0:1782107581.504934:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472508288 00000100:00100000:3.0:1782107581.505031:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1782107581.505041:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3324:x1868674472508288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107581.505077:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:1.0F:1782107581.505289:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107581.505442:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3324:x1868674472508288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 403us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107581.505450:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1782107581.508772:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472508288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107581.824846:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782107582.088315:0:7466:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1782107582.089255:0:7466:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1782107582.089348:0:7466:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1782107582.099796:0:7466:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1782107582.528137:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107582.528161:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472508416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107582.528236:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107582.528901:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472508416 00000100:00100000:1.0:1782107582.528910:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472508416 00000100:00100000:1.0:1782107582.528998:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1782107582.529008:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3324:x1868674472508416:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107582.529009:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1782107582.529046:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107582.529115:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3324:x1868674472508416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107582.529123:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1782107582.529784:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472508416:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782107582.609036:0:6604:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1782107582.609069:0:6604:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1782107582.771693:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107582.771746:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107582.771871:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447290112 00000100:00100000:3.0:1782107582.771881:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447290112 00000100:00100000:3.0:1782107582.772018:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 435 00000100:00100000:3.0:1782107582.772030:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447290112:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107582.772101:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447290112:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 74us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107582.772108:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 435 00000100:00100000:1.0:1782107582.772277:0:30650:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447290368 00000100:00100000:1.0:1782107582.772282:0:30650:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447290368 00000100:00100000:1.0:1782107582.772330:0:30650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 256 00000100:00100000:1.0:1782107582.772336:0:30650:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2373:x1868674447290368:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107582.772364:0:30650:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2373:x1868674447290368:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 29us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107582.772370:0:30650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 256 00000100:00080000:0.0:1782107582.772528:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0F:1782107582.781101:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107582.781155:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107582.781189:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447290496 00000100:00100000:2.0:1782107582.781199:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447290496 00000100:00100000:2.0:1782107582.781288:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 257 00000100:00100000:2.0:1782107582.781299:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447290496:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107582.781371:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447290496:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107582.781379:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 257 00000100:00080000:2.0:1782107582.781404:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107582.781678:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447290240 00000100:00100000:0.0:1782107582.781682:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447290240 00000100:00080000:3.0:1782107582.791147:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107582.791246:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 492 00000100:00100000:3.0:1782107582.791259:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+13:2373:x1868674447290240:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107582.791353:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+13:2373:x1868674447290240:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 99us (10265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107582.791372:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 492 00010000:00010000:1.0:1782107582.848129:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782107583.117758:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000001:00080000:3.0:1782107583.117791:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000100:00100000:3.0:1782107583.386490:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107583.386766:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447290624 00000100:00100000:0.0:1782107583.386776:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447290624 00000100:00100000:0.0:1782107583.386843:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 287 00000100:00100000:0.0:1782107583.386854:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+8:39527:x1868674447290624:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:0.0:1782107583.386875:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107583.386896:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d098 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608be1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.386963:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7d09f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.386993:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7d09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.387006:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7d09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107583.387223:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 7680 00000004:00200000:0.0:1782107583.387234:0:5808:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782107583.387326:0:5808:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7d09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.387353:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608be1 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.387370:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7d09f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608be1 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.387380:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8abe89048e00) 00010000:00010000:0.0:1782107583.387383:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782107583.387387:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439ec00, rc 0) 00000100:00100000:0.0:1782107583.387723:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+9:39527:x1868674447290624:12345-192.168.202.26@tcp:101:rm.0 Request processed in 859us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107583.387731:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 287 00000100:00100000:1.0:1782107583.404965:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107583.405038:0:5811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447290752 00000100:00100000:2.0:1782107583.405048:0:5811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447290752 00000100:00100000:2.0:1782107583.405114:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:2.0:1782107583.405125:0:5811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+9:39527:x1868674447290752:12345-192.168.202.26@tcp:37:rm.0 00000100:00100000:1.0:1782107583.426912:0:5811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+9:39527:x1868674447290752:12345-192.168.202.26@tcp:37:rm.0 Request processed in 21779us (21946us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107583.426925:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:3.0:1782107583.434832:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107583.437789:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447290880 00000100:00100000:0.0:1782107583.437810:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447290880 00000100:00100000:0.0:1782107583.437955:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 288 00000100:00100000:0.0:1782107583.437967:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+9:39527:x1868674447290880:12345-192.168.202.26@tcp:41:rm.0 00000004:00000024:0.0:1782107583.438049:0:5807:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7711227904 00000100:00100000:0.0:1782107583.438137:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+9:39527:x1868674447290880:12345-192.168.202.26@tcp:41:rm.0 Request processed in 173us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107583.438145:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 288 00000100:00100000:3.0:1782107583.443461:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107583.443634:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447291008 00000100:00100000:0.0:1782107583.443646:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447291008 00000100:00100000:0.0:1782107583.443699:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 289 00000100:00100000:0.0:1782107583.444168:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+9:39527:x1868674447291008:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:0.0:1782107583.444207:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107583.444233:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608be8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.446387:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.446415:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.446427:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.446443:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.446450:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.446456:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.448536:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7d0bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.448560:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7d0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.448916:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7d0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107583.448968:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x21:0x0]: returning size 3145729 00000004:00200000:0.0:1782107583.449006:0:5808:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782107583.449028:0:5808:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7d0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449041:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7d0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449050:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449058:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449065:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449071:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107583.449075:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449082:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449103:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8abe89048e00) 00010000:00010000:0.0:1782107583.449107:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107583.449112:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449119:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449130:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449146:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449152:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449157:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439ee00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107583.449160:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449166:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449174:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0xc0870d27 (ffff8abe89048900) 00010000:00010000:0.0:1782107583.449176:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107583.449179:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449185:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449224:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608be8 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449246:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7d0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608be8 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.449254:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8abe89048700) 00010000:00010000:0.0:1782107583.449257:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782107583.449264:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439f400, rc 0) 00000100:00100000:0.0:1782107583.449335:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+10:39527:x1868674447291008:12345-192.168.202.26@tcp:101:rm.0 Request processed in 5627us (5883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107583.449344:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 289 00000100:00100000:0.0:1782107583.455931:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107583.455965:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447291264 00000100:00100000:0.0:1782107583.455995:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447291264 00000100:00100000:0.0:1782107583.456048:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 290 00000100:00100000:0.0:1782107583.456059:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+10:39527:x1868674447291264:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:0.0:1782107583.456112:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782107583.456139:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f400/0xc2d453a189c7d0bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608be8 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456159:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8abe89048700) 00010000:00010000:0.0:1782107583.456175:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7d09f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608be1 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456183:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8abe89048e00) 00010000:00010000:0.0:1782107583.456186:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782107583.456219:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456233:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456241:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456257:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456279:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456286:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456629:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456638:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.456646:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782107583.457942:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8824 00000004:00080000:0.0:1782107583.457955:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852352981771ns, next at 853352978958ns, rc = 0 00000040:00080000:0.0:1782107583.458058:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8760 00000004:00080000:0.0:1782107583.458065:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852353091831ns, next at 853353090674ns, rc = 0 00000040:00080000:0.0:1782107583.458083:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].9, 64 off8888 00000040:00080000:0.0:1782107583.458097:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8824 00010000:00010000:0.0:1782107583.458206:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458221:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458230:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458238:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458251:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458258:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458271:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782107583.458290:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458296:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458302:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458308:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439e200 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107583.458312:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458319:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458331:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8abe89048600) 00010000:00010000:0.0:1782107583.458334:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782107583.458339:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458344:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7d0d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458360:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458372:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458378:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458383:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f200 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107583.458386:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458391:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458399:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8abe89048e00) 00010000:00010000:0.0:1782107583.458401:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107583.458404:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.458409:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d0c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107583.458419:0:5809:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d1940e1b reply state 00000000243b4f8a transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107583.458427:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782107583.458517:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+10:39527:x1868674447291264:12345-192.168.202.26@tcp:36:rm.0 Request processed in 2456us (2592us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1782107583.458526:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 290 00010000:00010000:1.0:1782107583.459076:0:5795:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782107583.459082:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.459099:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439e800 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:1.0:1782107583.459103:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.459121:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.459131:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8abe89048600) 00010000:00010000:1.0:1782107583.459134:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782107583.459138:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.459143:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7d0d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.459159:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107583.459161:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107583.459163:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107583.464209:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.464241:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.464249:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.464254:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439fc00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107583.464259:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.464266:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.464283:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0xc0870d27 (ffff8abe89048d00) 00010000:00010000:0.0:1782107583.464287:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107583.464292:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.464298:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d0c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107583.467126:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107583.467250:0:5810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447291520 00000100:00100000:3.0:1782107583.467262:0:5810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447291520 00000100:00100000:3.0:1782107583.467321:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:3.0:1782107583.467331:0:5810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+9:39527:x1868674447291520:12345-192.168.202.26@tcp:35:rm.0 00000100:00100000:3.0:1782107583.467693:0:5810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+10:39527:x1868674447291520:12345-192.168.202.26@tcp:35:rm.0 Request processed in 362us (574us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1782107583.467701:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:3.0:1782107583.470080:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107583.470260:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447291776 00000100:00100000:0.0:1782107583.470273:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447291776 00000100:00100000:0.0:1782107583.470343:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 291 00000100:00100000:0.0:1782107583.470354:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+10:39527:x1868674447291776:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:0.0:1782107583.470419:0:7463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782107583.470450:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7cd8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608b16 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.470493:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7cce7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608ae5 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.470506:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8abe89048e00) 00010000:00010000:0.0:1782107583.470588:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d44600/0xc2d453a189c7cccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608ade expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.470600:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a900) 00010000:00010000:0.0:1782107583.470607:0:7463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782107583.470629:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.470643:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.470652:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.470663:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.470669:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.470675:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.471012:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.471031:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.471038:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107583.476486:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 7680 00010000:00010000:0.0:1782107583.477083:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477165:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477173:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477178:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107583.477183:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477190:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477205:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8abe89048f00) 00010000:00010000:0.0:1782107583.477209:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782107583.477214:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477220:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d0ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477245:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477259:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477265:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477270:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f800 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107583.477273:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477279:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477288:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048900) 00010000:00010000:0.0:1782107583.477298:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107583.477302:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107583.477307:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7d0de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107583.477320:0:7463:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000013c06134 reply state 00000000a2706d8f transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107583.477329:0:7463:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782107583.477431:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+9:39527:x1868674447291776:12345-192.168.202.26@tcp:36:rm.0 Request processed in 7074us (7355us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1782107583.477441:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 291 00010000:00010000:1.0:1782107583.485217:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.485284:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.485293:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.485299:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439ee00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:1.0:1782107583.485303:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.485312:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.485326:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffff8abe89048000) 00010000:00010000:1.0:1782107583.485337:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107583.485343:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107583.485349:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d0e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107583.873694:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107584.577713:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3326:1868674472508544:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.577851:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107584.577901:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1868674472509056:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.577930:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107584.578008:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782107584.578035:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1868674472508672:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578075:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107584.578119:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472509184:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578145:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107584.578176:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472508800:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578265:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107584.578300:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107584.578306:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472508928:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578346:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107584.578429:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472508544 00000100:00100000:3.0:1782107584.578438:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472508544 00000100:00100000:3.0:1782107584.578519:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1782107584.578529:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3326:x1868674472508544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578592:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3326:x1868674472508544:12345-0@lo:400:kworker.0 Request processed in 65us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107584.578599:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1782107584.578629:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472509184 00000100:00100000:3.0:1782107584.578632:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472509184 00000100:00100000:3.0:1782107584.578663:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472508928 00000100:00100000:3.0:1782107584.578666:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472508928 00000100:00100000:3.0:1782107584.578687:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1782107584.578694:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472509184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578727:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472509184:12345-0@lo:400:kworker.0 Request processed in 34us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107584.578733:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1782107584.578745:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782107584.578751:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472508928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578781:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472508928:12345-0@lo:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107584.578787:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782107584.578804:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472509056 00000100:00100000:3.0:1782107584.578807:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472509056 00000100:00100000:3.0:1782107584.578854:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472508672 00000100:00100000:3.0:1782107584.578857:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472508672 00000100:00100000:3.0:1782107584.578868:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472508800 00000100:00100000:3.0:1782107584.578870:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472508800 00000100:00100000:3.0:1782107584.578884:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1782107584.578889:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1868674472509056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578918:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1868674472509056:12345-0@lo:400:kworker.0 Request processed in 29us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107584.578924:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1782107584.578935:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1782107584.578941:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1868674472508672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.578966:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3326:x1868674472508672:12345-0@lo:400:kworker.0 Request processed in 25us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107584.578992:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1782107584.579004:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1782107584.579010:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472508800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.579036:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472508800:12345-0@lo:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107584.579041:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00080000:3.0:1782107584.579064:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782107584.579068:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107584.579071:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107584.579099:0:3324:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1782107584.579104:0:3324:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abebf17bb80, transno 4294967302 00000004:00080000:3.0:1782107584.579114:0:3324:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abebfc4d500, transno 4294967303 00000004:00080000:3.0:1782107584.579117:0:3324:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abebfc4ea00, transno 4294967304 00000100:00100000:3.0:1782107584.579122:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472508928:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.579144:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472508800:0@lo:400:kworker.0 00000004:00080000:3.0:1782107584.579402:0:7035:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1782107584.579488:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3326:1868674472508672:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.579499:0:3326:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1782107584.579502:0:3326:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abebf17a300, transno 4294967304 00000004:00080000:3.0:1782107584.579525:0:3326:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abe85a6df80, transno 4294967306 00000004:00080000:3.0:1782107584.579529:0:3326:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abec0898380, transno 4294967307 00000004:00080000:3.0:1782107584.579531:0:3326:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abebef24e00, transno 4294967308 00000100:00100000:3.0:1782107584.579536:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472509184:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.579546:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3326:1868674472508544:0@lo:400:kworker.0 00000100:00100000:3.0:1782107584.579573:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1868674472509056:0@lo:400:kworker.0 00000004:00080000:3.0:1782107584.579703:0:7536:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 4 done 00010000:00010000:3.0:1782107584.897636:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107585.923732:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782107586.625729:0:7537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 855520754329ns, next at 856520752305ns, rc = 0 00000100:00100000:3.0:1782107586.627158:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472509312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107586.627228:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107586.627393:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472509312 00000100:00100000:0.0:1782107586.627410:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472509312 00000100:00100000:0.0:1782107586.627510:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1782107586.627521:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472509312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107586.627565:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107586.627613:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472509312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107586.628128:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1782107586.628190:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472509312:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107586.631787:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782107586.944875:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107587.651541:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472509440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107587.651619:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782107587.651755:0:7036:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 856546781551ns, next at 857546779578ns, rc = 0 00000100:00100000:3.0:1782107587.651824:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472509440 00000100:00100000:3.0:1782107587.651832:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472509440 00000100:00100000:3.0:1782107587.651997:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1782107587.652007:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472509440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782107587.652043:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782107587.652152:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472509440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107587.652160:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1782107587.652204:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472509440:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782107587.652308:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107587.891586:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107587.891633:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107587.891661:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107587.891683:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107587.891708:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447292288 00000100:00100000:3.0:1782107587.891718:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447292288 00000100:00100000:3.0:1782107587.891773:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447292160 00000100:00100000:3.0:1782107587.891776:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447292160 00000100:00100000:3.0:1782107587.891814:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 260 00000100:00100000:3.0:1782107587.891824:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447292288:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107587.891907:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447292288:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107587.891915:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 260 00000100:00100000:3.0:1782107587.891929:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 261 00000100:00100000:3.0:1782107587.891935:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2371:x1868674447292160:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107587.891955:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2371:x1868674447292160:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 21us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107587.891960:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 261 00000100:00100000:3.0:1782107587.891996:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447291904 00000100:00100000:3.0:1782107587.892000:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447291904 00000100:00100000:1.0:1782107587.892215:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447292032 00000100:00100000:1.0:1782107587.892220:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447292032 00000100:00100000:1.0:1782107587.892255:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 496 00000100:00100000:1.0:1782107587.892262:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+8:2371:x1868674447292032:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107587.892296:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+8:2371:x1868674447292032:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 35us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107587.892302:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 496 00000100:00100000:3.0:1782107587.893115:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 437 00000100:00100000:3.0:1782107587.893129:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447291904:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107587.893435:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447291904:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 311us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107587.893444:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 437 00000100:00080000:3.0:1782107587.893489:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782107587.893494:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107587.893497:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782107587.969138:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782107588.221386:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1782107588.221415:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:3.0:1782107588.221428:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:3.0:1782107588.221435:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1782107588.221438:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1782107588.221529:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472509568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782107588.221595:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107588.221646:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107588.221652:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472509696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782107588.221672:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107588.221703:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472509568 00000100:00100000:3.0:1782107588.221710:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472509568 00000100:00100000:3.0:1782107588.221756:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472509696 00000100:00100000:3.0:1782107588.221758:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472509696 00000100:00100000:3.0:1782107588.221787:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782107588.221796:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3326:x1868674472509568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782107588.221824:0:6578:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1782107588.221856:0:6578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 524288, mtime: 0x6a38cdb9, atime: 0x6a38cdb9, ctime: 0x6a38cdb9, blocks: 0x403 00010000:00010000:3.0:1782107588.221864:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.221901:0:6578:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107588.221904:0:6578:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107588.221909:0:6578:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.221927:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.221937:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.221945:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.221965:0:6578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782107588.222530:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3326:x1868674472509568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 733us (933us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782107588.222539:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782107588.222561:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782107588.222567:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3326:x1868674472509696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782107588.222581:0:6578:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1782107588.222597:0:6578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782107588.222601:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.222612:0:6578:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107588.222619:0:6578:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107588.222622:0:6578:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.222632:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.222640:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.222647:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.222662:0:6578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1782107588.223019:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3326:x1868674472509696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 451us (1345us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782107588.223026:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1782107588.223050:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782107588.223070:0:5795:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782107588.223076:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223084:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f5600 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:3.0:1782107588.223089:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223099:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223128:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223135:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021dad28c/0xc2d453a189c7d0f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223155:0:5795:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107588.223158:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223164:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f4000 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:3.0:1782107588.223167:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223173:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223182:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223189:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0e9fdc/0xc2d453a189c7d0fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.223200:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107588.223202:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107588.223209:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782107588.223240:0:3326:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abd83421880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1782107588.223246:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472509696:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1782107588.223256:0:3326:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abd83421c00/2, rc 0, transno 4294967309 00000100:00100000:3.0:1782107588.223259:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472509568:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782107588.223273:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107588.223769:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472509824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782107588.223820:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107588.223862:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107588.223868:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472509952:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782107588.223889:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107588.223940:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472509824 00000100:00100000:0.0:1782107588.223946:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472509824 00000100:00100000:0.0:1782107588.224007:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472509952 00000100:00100000:0.0:1782107588.224010:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472509952 00000100:00100000:0.0:1782107588.224031:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782107588.224039:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3324:x1868674472509824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782107588.224058:0:8608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1782107588.224081:0:8608:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 3145728, mtime: 0x6a38cdba, atime: 0x0, ctime: 0x6a38cdba, blocks: 0x807 00010000:00010000:0.0:1782107588.224088:0:8608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224098:0:8608:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1782107588.224100:0:8608:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1782107588.224103:0:8608:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224115:0:8608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224135:0:8608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224142:0:8608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224157:0:8608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782107588.224713:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3324:x1868674472509824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 673us (891us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782107588.224721:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782107588.224739:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782107588.224745:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3324:x1868674472509952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782107588.224757:0:8608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00010000:00010000:0.0:1782107588.224768:0:8608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224797:0:8608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d67f1d3/0xc2d453a189c7cfbf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608b9b expref: 5 pid: 8608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224804:0:8608:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1782107588.224806:0:8608:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1782107588.224808:0:8608:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224836:0:8608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d67f1d3/0xc2d453a189c7cfbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608b9b expref: 5 pid: 8608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107588.224859:0:8608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d67f1d3/0xc2d453a189c7cfbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608b9b expref: 5 pid: 8608 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107588.224874:0:8608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8608:1868674472510080:192.168.202.26@tcp:104: 00000100:00100000:0.0:1782107588.224943:0:8608:0:(client.c:2692:ptlrpc_set_wait()) set ffff8abebf64b900 going to sleep for 11 seconds 00000004:00080000:0.0:1782107588.224998:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abe85a6d500/2, rc 0, transno 4294967306 00000100:00100000:0.0:1782107588.225004:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472509824:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782107588.227162:0:8257:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107588.227178:0:8257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.227192:0:8257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439e000 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:3.0:1782107588.227197:0:8257:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.227207:0:8257:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.227228:0:8257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.227235:0:8257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008efb8d74/0xc2d453a189c7d101 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.227255:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107588.227256:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107588.227258:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107588.233370:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107588.233798:0:5792:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447292416 00000100:00100000:2.0:1782107588.233809:0:5792:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447292416 00010000:00010000:2.0:1782107588.233847:0:5792:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d67f1d3/0xc2d453a189c7cfbf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608b9b expref: 6 pid: 8608 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107588.234180:0:8608:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8608:1868674472510080:192.168.202.26@tcp:104: 00010000:00010000:1.0:1782107588.234205:0:8608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107588.235161:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:2.0:1782107588.235177:0:5792:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2373:x1868674447292416:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782107588.235197:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782107588.235210:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d67f1d3/0xc2d453a189c7cfbf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608b9b expref: 6 pid: 8608 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107588.235225:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d67f1d3/0xc2d453a189c7cfbf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608b9b expref: 6 pid: 8608 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107588.235246:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d67f1d3/0xc2d453a189c7cfbf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608b9b expref: 6 pid: 8608 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107588.235261:0:5792:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1782107588.235263:0:5792:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1782107588.235267:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107588.235277:0:5792:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107588.235300:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782107588.235375:0:5792:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447292416:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 189us (2006us total) trans 0 rc 0/0 00010000:00010000:3.0:1782107588.235419:0:8608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.235428:0:8608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.235437:0:8608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.235444:0:8608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.235462:0:8608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782107588.236061:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3324:x1868674472509952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11315us (12169us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782107588.236071:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1782107588.236101:0:5795:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107588.236107:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.236116:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439ee00 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:3.0:1782107588.236120:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.236129:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.236156:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.236163:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000511b67f3/0xc2d453a189c7d108 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107588.236181:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107588.236183:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107588.236185:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782107588.236414:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8abe85a6dc00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1782107588.236421:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472509952:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782107588.240387:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 61 00010000:00010000:0.0:1782107588.995185:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107589.696328:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472510464:0@lo:400:kworker.0 00000100:00100000:0.0:1782107589.696407:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107589.696460:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782107589.696466:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472510592:0@lo:400:kworker.0 00000100:00100000:0.0:1782107589.696495:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107589.696610:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472510336:0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.696641:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107589.696676:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472510848:0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.696698:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107589.696718:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782107589.696724:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3327:1868674472510208:0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.696751:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107589.696780:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1868674472510720:0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.696813:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107589.696841:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472510592 00000100:00100000:1.0:1782107589.696848:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472510592 00000100:00100000:1.0:1782107589.696903:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472510848 00000100:00100000:1.0:1782107589.696907:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472510848 00000100:00100000:1.0:1782107589.696928:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782107589.696936:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3324:x1868674472510592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.697011:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3324:x1868674472510592:12345-0@lo:400:kworker.0 Request processed in 75us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107589.697124:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782107589.697143:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782107589.697150:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3327:x1868674472510848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.697183:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3327:x1868674472510848:12345-0@lo:400:kworker.0 Request processed in 33us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107589.697190:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782107589.697212:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472510464 00000100:00100000:1.0:1782107589.697215:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472510464 00000100:00100000:1.0:1782107589.697240:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472510336 00000100:00100000:1.0:1782107589.697243:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472510336 00000100:00100000:1.0:1782107589.697254:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472510720 00000100:00100000:1.0:1782107589.697256:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472510720 00000100:00100000:1.0:1782107589.697270:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1782107589.697276:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472510464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.697307:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472510464:12345-0@lo:400:kworker.0 Request processed in 31us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107589.697314:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1782107589.697324:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1782107589.697330:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472510336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.697363:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472510336:12345-0@lo:400:kworker.0 Request processed in 33us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107589.697370:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1782107589.697437:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1782107589.697445:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1868674472510720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.697473:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1868674472510720:12345-0@lo:400:kworker.0 Request processed in 31us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107589.697479:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1782107589.697526:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1868674472510720:0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.697536:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472510336:0@lo:400:kworker.0 00000100:00100000:1.0:1782107589.697546:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472510848:0@lo:400:kworker.0 00000100:00100000:3.0:1782107589.697645:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472510208 00000100:00100000:3.0:1782107589.697650:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472510208 00000100:00100000:3.0:1782107589.697686:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1782107589.697693:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3327:x1868674472510208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107589.697733:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3327:x1868674472510208:12345-0@lo:400:kworker.0 Request processed in 42us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107589.697740:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00080000:3.0:1782107589.697775:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782107589.697779:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107589.697797:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3327:1868674472510208:0@lo:400:kworker.0 00000100:00100000:0.0:1782107589.698084:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472510592:0@lo:400:kworker.0 00000100:00100000:0.0:1782107589.698099:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472510464:0@lo:400:kworker.0 00010000:00010000:3.0:1782107590.018207:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107591.041825:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107591.293868:0:31359:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 01:53:10 (1782107590) 00000100:00100000:3.0:1782107591.744227:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782107591.744249:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472510976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107591.744308:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107591.748023:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472510976 00000100:00100000:0.0:1782107591.748039:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472510976 00000100:00080000:3.0:1782107591.748189:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107591.748240:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1782107591.748252:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1868674472510976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107591.748303:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107591.748390:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1868674472510976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (4080us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107591.748398:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1782107591.748480:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472510976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107592.070954:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782107592.336072:0:7466:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:02000400:0.0:1782107592.651776:0:31408:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27b needs >= 8 OSTs 00000100:00100000:3.0:1782107592.772287:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472511104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107592.772372:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107592.772449:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472511104 00000100:00100000:3.0:1782107592.772457:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472511104 00000100:00100000:3.0:1782107592.772515:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1782107592.772524:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1868674472511104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782107592.772560:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1782107592.772600:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1868674472511104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107592.772607:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1782107592.772627:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107592.772656:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472511104:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1782107592.840835:0:6604:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1782107592.840852:0:6604:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:3.0:1782107593.012211:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107593.012265:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107593.012300:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107593.012402:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107593.012952:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447292544 00000100:00100000:0.0:1782107593.012966:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447292544 00000100:00100000:0.0:1782107593.013062:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 439 00000100:00100000:0.0:1782107593.013073:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447292544:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107593.013150:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447292544:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 80us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107593.013158:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 439 00000100:00100000:1.0:1782107593.014675:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447292800 00000100:00100000:1.0:1782107593.014686:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447292800 00000100:00100000:1.0:1782107593.014773:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447292928 00000100:00100000:1.0:1782107593.014777:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447292928 00000100:00100000:1.0:1782107593.014814:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 264 00000100:00100000:1.0:1782107593.014823:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447292800:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107593.014896:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447292800:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 75us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107593.014903:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 264 00000100:00100000:1.0:1782107593.015302:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 265 00000100:00100000:1.0:1782107593.015311:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447292928:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107593.015340:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447292928:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 31us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107593.015361:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 265 00000100:00080000:3.0:1782107593.016165:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107593.016171:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107593.023132:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447292672 00000100:00100000:2.0:1782107593.023151:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447292672 00000100:00100000:2.0:1782107593.023263:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 500 00000100:00100000:2.0:1782107593.023276:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447292672:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107593.023377:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447292672:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 104us (11075us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107593.023397:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 500 00000100:00080000:0.0:1782107593.023666:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782107593.090062:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107594.114656:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107594.304615:0:31458:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27c: test creating with n+2 OSTs ======= 01:53:13 (1782107593) 00000100:00100000:3.0:1782107594.821468:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3326:1868674472511232:0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.821560:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472511360:0@lo:400:kworker.0 00000100:00100000:3.0:1782107594.821564:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107594.821775:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472511616:0@lo:400:kworker.0 00000100:00100000:0.0:1782107594.821838:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472511488:0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.821903:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107594.821948:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472511872:0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.822027:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107594.822054:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107594.822060:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1868674472511744:0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.822084:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107594.822121:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472511360 00000100:00100000:2.0:1782107594.822131:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472511360 00000100:00100000:2.0:1782107594.822173:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472511744 00000100:00100000:2.0:1782107594.822176:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472511744 00000100:00100000:2.0:1782107594.822202:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1782107594.822209:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472511360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.822257:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472511360:12345-0@lo:400:kworker.0 Request processed in 48us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107594.822264:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1782107594.822280:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1782107594.822286:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1868674472511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.822311:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1868674472511744:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107594.822316:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1782107594.822334:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472511872 00000100:00100000:2.0:1782107594.822337:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472511872 00000100:00100000:2.0:1782107594.822365:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782107594.822371:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472511872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.822417:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472511872:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107594.822423:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782107594.822462:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1868674472511744:0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.822472:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472511360:0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.822479:0:3327:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1782107594.822484:0:3327:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abd83421c00, transno 4294967309 00000004:00080000:2.0:1782107594.822494:0:3327:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abd83421880, transno 4294967310 00000100:00100000:2.0:1782107594.822498:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472511872:0@lo:400:kworker.0 00000100:00100000:3.0:1782107594.822814:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472511232 00000100:00100000:3.0:1782107594.822819:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472511232 00000100:00100000:3.0:1782107594.822855:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1782107594.822879:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3326:x1868674472511232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107594.822940:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3326:x1868674472511232:12345-0@lo:400:kworker.0 Request processed in 77us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107594.822948:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1782107594.823007:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3326:1868674472511232:0@lo:400:kworker.0 00000100:00080000:3.0:1782107594.823052:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107594.823056:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107594.826818:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107594.826922:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472511616 00000100:00100000:1.0:1782107594.826932:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472511616 00000100:00080000:3.0:1782107594.827068:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107594.832161:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782107594.832189:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472511616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107594.832301:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472511616:12345-0@lo:400:kworker.0 Request processed in 127us (5491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107594.832309:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1782107594.832386:0:3325:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1782107594.832393:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abe85a6d500, transno 4294967306 00000004:00080000:3.0:1782107594.832417:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8abe85a6dc00, transno 4294967307 00000100:00100000:3.0:1782107594.832425:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472511616:0@lo:400:kworker.0 00000100:00100000:0.0:1782107594.834706:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107594.837443:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472511488 00000100:00100000:2.0:1782107594.837457:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472511488 00000100:00080000:3.0:1782107594.837621:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107594.837679:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1782107594.837690:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472511488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107594.837804:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472511488:12345-0@lo:400:kworker.0 Request processed in 116us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107594.837811:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1782107594.837941:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472511488:0@lo:400:kworker.0 00010000:00010000:0.0:1782107595.137281:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107595.596838:0:31507:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27c needs >= 8 OSTs 00010000:00010000:3.0:1782107596.162565:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107596.865024:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472512000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107596.865094:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107596.865332:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472512000 00000100:00100000:0.0:1782107596.865340:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472512000 00000100:00100000:0.0:1782107596.865406:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1782107596.865415:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472512000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107596.865447:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107596.865484:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472512000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107596.865489:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1782107596.865523:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472512000:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107596.866224:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782107597.184114:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107597.240489:0:31555:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 01:53:16 (1782107596) 00000100:00100000:1.0:1782107597.889116:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782107597.889140:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472512128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107597.889221:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107597.889574:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472512128 00000100:00100000:2.0:1782107597.889582:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472512128 00000100:00100000:2.0:1782107597.889653:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1782107597.889665:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472512128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107597.889717:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107597.889770:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472512128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107597.889777:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:3.0:1782107597.889998:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107597.892930:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472512128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107598.127351:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107598.127393:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107598.127434:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107598.127480:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447293312 00000100:00100000:3.0:1782107598.127532:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447293056 00000100:00100000:3.0:1782107598.127542:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447293056 00000100:00100000:3.0:1782107598.127597:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 441 00000100:00100000:1.0:1782107598.127600:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447293312 00000100:00100000:3.0:1782107598.127608:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447293056:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107598.127657:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 268 00000100:00100000:1.0:1782107598.127666:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447293312:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107598.127685:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447293056:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107598.127703:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 441 00000100:00100000:1.0:1782107598.127717:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447293312:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107598.127727:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 268 00000100:00080000:1.0:1782107598.127749:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107598.127910:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447293184 00000100:00100000:2.0:1782107598.127922:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447293184 00000100:00100000:2.0:1782107598.128000:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 504 00000100:00100000:2.0:1782107598.128009:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447293184:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107598.128040:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447293184:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107598.128047:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 504 00000100:00080000:3.0:1782107598.128946:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107598.135921:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107598.136675:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447293440 00000100:00100000:1.0:1782107598.136700:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447293440 00000100:00080000:3.0:1782107598.136824:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107598.136848:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:1.0:1782107598.136861:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2369:x1868674447293440:12345-192.168.202.26@tcp:9:kworker.0 00000020:00000080:1.0:1782107598.136892:0:8608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc2d453a189c7cdf1 00000100:00080000:1.0:1782107598.136901:0:8608:0:(import.c:65:import_set_state_nolock()) ffff8abeb3ec6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782107598.136952:0:8608:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1782107598.137242:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107598.137261:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+2:2369:x1868674447293440:12345-192.168.202.26@tcp:9:kworker.0 Request processed in 402us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107598.137269:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 42 00010000:00010000:3.0:1782107598.208376:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107598.677617:0:31603:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27d needs >= 8 OSTs 00010000:00010000:3.0:1782107599.232420:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107599.936378:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107599.936574:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472512384:0@lo:400:kworker.0 00000100:00100000:2.0:1782107599.936647:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107599.936758:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3327:1868674472512256:0@lo:400:kworker.0 00000100:00100000:2.0:1782107599.936786:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107599.936937:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472512384 00000100:00100000:3.0:1782107599.936945:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472512384 00000100:00100000:3.0:1782107599.937018:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1782107599.937029:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472512384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107599.937085:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472512384:12345-0@lo:400:kworker.0 Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107599.937092:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1782107599.937304:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472512384:0@lo:400:kworker.0 00000100:00100000:1.0:1782107599.937332:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472512256 00000100:00100000:1.0:1782107599.937337:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472512256 00000100:00100000:1.0:1782107599.937373:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1782107599.937380:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3327:x1868674472512256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107599.937436:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3327:x1868674472512256:12345-0@lo:400:kworker.0 Request processed in 56us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107599.937442:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1782107599.937525:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3327:1868674472512256:0@lo:400:kworker.0 00000100:00100000:1.0:1782107599.937858:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472512512:0@lo:400:kworker.0 00000100:00100000:1.0:1782107599.937888:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107599.937989:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472512512 00000100:00100000:2.0:1782107599.937993:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472512512 00000100:00100000:2.0:1782107599.938031:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1782107599.938039:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472512512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107599.938108:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472512640:0@lo:400:kworker.0 00000100:00100000:3.0:1782107599.938140:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782107599.938303:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107599.938487:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1868674472512768:0@lo:400:kworker.0 00000100:00100000:3.0:1782107599.938526:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107599.938553:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107599.938559:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472512896:0@lo:400:kworker.0 00000100:00100000:3.0:1782107599.938581:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107599.938816:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472512768 00000100:00100000:0.0:1782107599.938821:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472512768 00000100:00100000:0.0:1782107599.938867:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1782107599.938874:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1868674472512768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107599.938916:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3326:x1868674472512768:12345-0@lo:400:kworker.0 Request processed in 42us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107599.938922:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1782107599.938952:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472512640 00000100:00100000:0.0:1782107599.938956:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472512640 00000100:00100000:0.0:1782107599.939002:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782107599.939010:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472512640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107599.939041:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472512640:12345-0@lo:400:kworker.0 Request processed in 33us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107599.939048:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782107599.939057:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472512896 00000100:00100000:0.0:1782107599.939060:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472512896 00000100:00100000:0.0:1782107599.939081:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1782107599.939087:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472512896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107599.939114:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472512896:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107599.939119:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1782107599.939203:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107599.939206:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107599.939208:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107599.939233:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472512640:0@lo:400:kworker.0 00000100:00100000:3.0:1782107599.939269:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472512896:0@lo:400:kworker.0 00000100:00100000:3.0:1782107599.939280:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3326:1868674472512768:0@lo:400:kworker.0 00000100:00100000:2.0:1782107599.939426:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472512512:12345-0@lo:400:kworker.0 Request processed in 1388us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107599.939434:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1782107599.939626:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472512512:0@lo:400:kworker.0 00010000:00010000:3.0:1782107600.260742:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107600.679803:0:31651:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 01:53:19 (1782107599) 00010000:00010000:3.0:1782107601.280729:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107601.984826:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782107601.984848:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472513024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107601.984915:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107601.985173:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472513024 00000100:00100000:1.0:1782107601.985181:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472513024 00000100:00100000:1.0:1782107601.985253:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1782107601.985265:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472513024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107601.985303:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107601.985362:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472513024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107601.985383:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1782107601.985471:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472513024:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107601.985554:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1782107602.220845:0:31700:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27e needs >= 8 OSTs 00010000:00010000:3.0:1782107602.304218:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782107602.595245:0:7466:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7809e99e-e82d-45c5-af74-069d8f4d001a 00000020:00000080:2.0:1782107602.595255:0:7466:0:(genops.c:906:class_export_put()) final put ffff8abeb3ec0800/7809e99e-e82d-45c5-af74-069d8f4d001a 00000020:00000080:3.0:1782107602.595333:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8abeb3ec0800/7809e99e-e82d-45c5-af74-069d8f4d001a for lustre-OST0001 00000020:00000080:3.0:1782107602.595482:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8abeb3ec6000 for lustre-OST0001 00000100:00100000:3.0:1782107603.009141:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107603.009653:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472513152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107603.009735:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107603.010037:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472513152 00000100:00100000:0.0:1782107603.010048:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472513152 00000100:00100000:0.0:1782107603.010541:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1782107603.010554:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472513152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107603.010594:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107603.010665:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472513152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107603.010673:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1782107603.011044:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472513152:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782107603.011224:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107603.252135:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107603.252179:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107603.252240:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107603.252596:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447293824 00000100:00100000:1.0:1782107603.252606:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447293824 00000100:00100000:1.0:1782107603.252695:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 271 00000100:00100000:1.0:1782107603.252707:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447293824:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107603.252786:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447293824:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 81us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107603.252794:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 271 00000100:00100000:0.0:1782107603.252983:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447293568 00000100:00100000:0.0:1782107603.252988:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447293568 00000100:00100000:0.0:1782107603.253019:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 443 00000100:00100000:0.0:1782107603.253028:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447293568:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107603.253058:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447293568:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107603.253066:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 443 00000100:00080000:2.0:1782107603.253242:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107603.253817:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447293696 00000100:00100000:3.0:1782107603.253824:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447293696 00000100:00100000:3.0:1782107603.253942:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 508 00000100:00100000:3.0:1782107603.253952:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447293696:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107603.254025:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447293696:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 74us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107603.254032:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 508 00000100:00080000:1.0:1782107603.254203:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782107603.331361:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107603.994792:0:31752:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 01:53:22 (1782107602) 00010000:00010000:3.0:1782107604.352411:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107605.056420:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472513408:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.056489:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107605.056535:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472513920:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.056557:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107605.056581:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782107605.056587:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3327:1868674472513280:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.056612:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107605.056646:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1868674472513792:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.056665:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107605.056686:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472513536:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.056708:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107605.056725:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107605.056730:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472513664:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.056748:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107605.056775:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472513408 00000100:00100000:2.0:1782107605.056782:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472513408 00000100:00100000:2.0:1782107605.056832:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472513792 00000100:00100000:2.0:1782107605.056835:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472513792 00000100:00100000:2.0:1782107605.056854:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472513536 00000100:00100000:2.0:1782107605.056856:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472513536 00000100:00100000:2.0:1782107605.056871:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1782107605.056880:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472513408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.056927:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472513408:12345-0@lo:400:kworker.0 Request processed in 48us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107605.056932:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1782107605.056960:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1782107605.056965:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1868674472513792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057019:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1868674472513792:12345-0@lo:400:kworker.0 Request processed in 54us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107605.057025:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1782107605.057034:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1782107605.057039:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472513536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057065:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1868674472513536:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107605.057069:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1782107605.057099:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472513920 00000100:00100000:2.0:1782107605.057102:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472513920 00000100:00100000:2.0:1782107605.057124:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472513664 00000100:00100000:2.0:1782107605.057126:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472513664 00000100:00100000:2.0:1782107605.057144:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782107605.057150:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472513920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057188:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472513920:12345-0@lo:400:kworker.0 Request processed in 38us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107605.057193:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782107605.057203:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782107605.057208:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472513664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057232:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472513664:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107605.057237:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782107605.057252:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472513280 00000100:00100000:2.0:1782107605.057255:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472513280 00000100:00100000:2.0:1782107605.057280:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1782107605.057293:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3327:x1868674472513280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057323:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3327:x1868674472513280:12345-0@lo:400:kworker.0 Request processed in 31us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107605.057329:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00080000:2.0:1782107605.057368:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782107605.057372:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782107605.057375:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107605.057414:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472513664:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057423:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3324:1868674472513536:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057529:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3327:1868674472513280:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057541:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1868674472513792:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057549:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472513408:0@lo:400:kworker.0 00000100:00100000:2.0:1782107605.057558:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472513920:0@lo:400:kworker.0 00010000:00010000:3.0:1782107605.377497:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107605.728635:0:31800:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27f needs >= 8 OSTs 00010000:00010000:0.0:1782107606.405090:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107607.108422:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782107607.108445:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472514048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107607.108515:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107607.108578:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472514048 00000100:00100000:1.0:1782107607.108585:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472514048 00000100:00100000:1.0:1782107607.108651:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1782107607.108662:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472514048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107607.108699:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107607.108736:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472514048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107607.108743:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1782107607.108766:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107607.108798:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472514048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107607.433113:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107607.490367:0:31848:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 01:53:26 (1782107606) 00000100:00100000:1.0:1782107607.710484:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107607.712333:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447293952 00000100:00100000:0.0:1782107607.712346:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447293952 00000100:00100000:0.0:1782107607.712417:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 292 00000100:00100000:0.0:1782107607.712428:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:41287:x1868674447293952:12345-192.168.202.26@tcp:101:mkdir.0 00010000:00010000:0.0:1782107607.712449:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107607.712506:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d10f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608bef expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.712584:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d116 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.712597:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.712621:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107607.712828:0:5809:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782107607.712833:0:5809:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782107607.712902:0:5809:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.712926:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d10f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608bef expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.712942:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608bef expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.712951:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048d00) 00010000:00010000:0.0:1782107607.712954:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782107607.712958:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439ee00, rc 0) 00000100:00100000:0.0:1782107607.713048:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:41287:x1868674447293952:12345-192.168.202.26@tcp:101:mkdir.0 Request processed in 622us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107607.713057:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 292 00000100:00080000:1.0:1782107607.714474:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107607.728336:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107607.728367:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107607.728405:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447294080 00000100:00100000:0.0:1782107607.728413:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447294080 00000100:00100000:0.0:1782107607.728452:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447294336 00000100:00100000:0.0:1782107607.728455:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447294336 00000100:00100000:0.0:1782107607.728471:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 293 00000100:00100000:0.0:1782107607.728480:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+7:2371:x1868674447294080:12345-192.168.202.26@tcp:41:mkdir.0 00000004:00000024:0.0:1782107607.728524:0:5807:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782107607.728582:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+7:2371:x1868674447294080:12345-192.168.202.26@tcp:41:mkdir.0 Request processed in 103us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107607.728590:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 293 00000100:00100000:0.0:1782107607.728616:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 294 00000100:00100000:0.0:1782107607.728623:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:41287:x1868674447294336:12345-192.168.202.26@tcp:36:mkdir.0 00010000:00010000:0.0:1782107607.728661:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782107607.728687:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d116 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608bef expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.728709:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048d00) 00010000:00010000:0.0:1782107607.728721:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782107607.728957:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.728994:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.729005:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.729060:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.729072:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.729078:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107607.730120:0:5807:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23:0x0]: returning size 512 00010000:00010000:0.0:1782107607.730132:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.730141:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.730149:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.730155:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107607.730160:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.730168:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.733924:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048700) 00010000:00010000:0.0:1782107607.733931:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107607.733939:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.733948:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d11d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107607.734084:0:5807:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000eedd13f3 reply state 00000000c7785ff2 transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107607.734105:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782107607.742123:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+7:41287:x1868674447294336:12345-192.168.202.26@tcp:36:mkdir.0 Request processed in 13489us (13743us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1782107607.742135:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 294 00010000:00010000:2.0:1782107607.745567:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.745581:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.745589:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.745596:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439fc00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107607.745600:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.745628:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.745643:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff8abe89048500) 00010000:00010000:2.0:1782107607.745646:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107607.745652:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.745658:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7d124 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107607.818183:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107607.818331:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447294464 00000100:00100000:2.0:1782107607.818342:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447294464 00000100:00100000:2.0:1782107607.818400:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 295 00000100:00100000:2.0:1782107607.818410:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+6:41290:x1868674447294464:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1782107607.818433:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107607.818454:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7d12b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608bf6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.818515:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7d132 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.818528:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7d132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.818539:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7d132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782107607.818596:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782107607.818637:0:7463:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782107607.818664:0:7463:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7d132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.818687:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7d12b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608bf6 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.818703:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7d132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608bf6 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.818712:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe898b2900) 00010000:00010000:2.0:1782107607.818715:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782107607.818719:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1349c00, rc 0) 00000100:00100000:2.0:1782107607.818779:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+7:41290:x1868674447294464:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 369us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107607.818786:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 295 00000100:00100000:0.0:1782107607.824842:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107607.824923:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447294592 00000100:00100000:1.0:1782107607.824934:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447294592 00000100:00100000:1.0:1782107607.825012:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 296 00000100:00100000:1.0:1782107607.825023:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:41290:x1868674447294592:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1782107607.825045:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107607.825064:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d44200/0xc2d453a189c7d139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608bfd expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.825123:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.825138:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.825160:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.825180:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.825358:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.825367:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825526:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d14e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825534:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825542:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107607.825571:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23:0x0]: returning size 512 00000004:00200000:0.0:1782107607.825574:0:5808:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782107607.825594:0:5808:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825617:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825624:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825630:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825636:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec0d45400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107607.825640:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825661:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825675:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe898b2900) 00010000:00010000:0.0:1782107607.825678:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107607.825683:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825690:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45400/0xc2d453a189c7d140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825703:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825710:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825715:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825720:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec0d45e00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107607.825723:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825729:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825735:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff8abe84d6aa00) 00010000:00010000:0.0:1782107607.825737:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107607.825740:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825754:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d45e00/0xc2d453a189c7d147 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825783:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec0d44200/0xc2d453a189c7d139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608bfd expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825795:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f600/0xc2d453a189c7d14e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608bfd expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.825803:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8abe89048700) 00010000:00010000:0.0:1782107607.825806:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782107607.825808:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439f600, rc 0) 00000100:00100000:0.0:1782107607.825864:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+8:41290:x1868674447294592:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 843us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107607.825871:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 296 00000100:00100000:3.0:1782107607.829312:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107607.829406:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447294720 00000100:00100000:2.0:1782107607.829417:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447294720 00000100:00100000:2.0:1782107607.829467:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 297 00000100:00100000:2.0:1782107607.829477:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+8:41290:x1868674447294720:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1782107607.829498:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107607.829518:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7d155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608c04 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829612:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829627:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829647:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829662:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829670:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829677:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829742:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829750:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829757:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829763:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349200 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107607.829767:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829774:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829786:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8abe89048700) 00010000:00010000:2.0:1782107607.829788:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107607.829793:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829804:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349200/0xc2d453a189c7d15c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829816:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829822:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829828:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829833:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107607.829835:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829842:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829848:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0xe0be4298 (ffff8abe898b2500) 00010000:00010000:2.0:1782107607.829850:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107607.829853:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829859:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829887:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7d155 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c04 expref: 9 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829905:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8abe89048700) 00010000:00010000:2.0:1782107607.829907:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107607.829911:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7d155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c04 expref: 9 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.829921:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1349400, rc 0) 00000100:00100000:2.0:1782107607.830017:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+8:41290:x1868674447294720:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 541us (713us total) trans 0 rc 301/301 00000100:00100000:2.0:1782107607.830024:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 297 00000100:00100000:1.0:1782107607.841252:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107607.841374:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447294976 00000100:00100000:0.0:1782107607.841385:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447294976 00000100:00100000:0.0:1782107607.841440:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 298 00000100:00100000:0.0:1782107607.841450:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+8:41290:x1868674447294976:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1782107607.841469:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107607.841489:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d16a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608c0b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.841629:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.841644:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.841668:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.841682:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.841689:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.841696:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842572:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842584:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842592:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107607.842610:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 0 00010000:00010000:0.0:1782107607.842634:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842641:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842649:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842656:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439fa00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107607.842666:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842674:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842686:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8abe89048700) 00010000:00010000:0.0:1782107607.842690:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107607.842694:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842701:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fa00/0xc2d453a189c7d171 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107607.842713:0:5808:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fa6addea reply state 0000000003d6eacb transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107607.842722:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782107607.842749:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ee00/0xc2d453a189c7d16a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842762:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.842770:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff8abe89048100) 00010000:00010000:0.0:1782107607.842772:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782107607.842774:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439f200, rc 0) 00000100:00100000:0.0:1782107607.843070:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+11:41290:x1868674447294976:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1621us (1826us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1782107607.843079:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 298 00010000:00010000:1.0:1782107607.853699:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.853718:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.853740:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.853747:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439ea00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:1.0:1782107607.853752:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.853761:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.853779:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0xe0be4298 (ffff8abe89048d00) 00010000:00010000:1.0:1782107607.853782:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107607.853787:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107607.853794:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7d178 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107607.860487:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107607.860742:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447295232 00000100:00100000:2.0:1782107607.860753:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447295232 00000100:00100000:2.0:1782107607.860799:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 299 00000100:00100000:2.0:1782107607.860807:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+10:41290:x1868674447295232:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1782107607.860829:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107607.860846:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7d18d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608c12 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.860939:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.860956:0:7463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.860965:0:7463:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.861019:0:7463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107607.861049:0:7463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 11 pid: 5808 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107607.861063:0:7463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7463:1868674472514176:192.168.202.26@tcp:104: 00000100:00100000:2.0:1782107607.861159:0:7463:0:(client.c:2692:ptlrpc_set_wait()) set ffff8abe84237d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782107607.865781:0:7463:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7463:1868674472514176:192.168.202.26@tcp:104: 00010000:00010000:2.0:1782107607.865809:0:7463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107607.873221:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107607.882061:0:5793:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447295360 00000100:00100000:0.0:1782107607.882077:0:5793:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447295360 00010000:00010000:0.0:1782107607.882126:0:5793:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 12 pid: 5808 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107607.882157:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:0.0:1782107607.882166:0:5793:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+12:2372:x1868674447295360:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782107607.882181:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782107607.882188:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 12 pid: 5808 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.882201:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 12 pid: 5808 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.882222:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7d17f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c0b expref: 12 pid: 5808 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.882238:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff8abe89048100) 00010000:00010000:0.0:1782107607.882243:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.882252:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.882260:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107607.882295:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782107607.882362:0:5793:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+11:2372:x1868674447295360:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 196us (9150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107607.882382:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 62 00010000:00010000:3.0:1782107607.882472:0:7463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882485:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107607.882504:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 0 00010000:00010000:3.0:1782107607.882762:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882771:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882779:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882785:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107607.882789:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882796:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882806:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff8abe89048100) 00010000:00010000:3.0:1782107607.882809:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782107607.882812:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882818:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7d194 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882856:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7d18d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c12 expref: 10 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882876:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8abe89048700) 00010000:00010000:3.0:1782107607.882878:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782107607.882882:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7d18d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608c12 expref: 10 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107607.882891:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1349400, rc 0) 00000100:00100000:3.0:1782107607.882917:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+9:41290:x1868674447295232:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 22111us (22440us total) trans 0 rc 301/301 00000100:00100000:3.0:1782107607.882924:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 299 00000100:00100000:3.0:1782107607.893890:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107607.894006:0:5811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447295616 00000100:00100000:0.0:1782107607.894018:0:5811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447295616 00000100:00100000:0.0:1782107607.894077:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:0.0:1782107607.894087:0:5811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+9:41290:x1868674447295616:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:0.0:1782107607.894321:0:5811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+10:41290:x1868674447295616:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 235us (439us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1782107607.894330:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:0.0:1782107608.129779:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782107608.129821:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472514304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107608.130118:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107608.130180:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472514304 00000100:00100000:2.0:1782107608.130362:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472514304 00000100:00100000:2.0:1782107608.130434:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1782107608.130445:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472514304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107608.130480:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107608.130525:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472514304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107608.130532:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:3.0:1782107608.130586:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107608.131122:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472514304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107608.371846:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107608.371891:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107608.372691:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447295872 00000100:00100000:2.0:1782107608.372704:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447295872 00000100:00100000:2.0:1782107608.372798:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 512 00000100:00100000:2.0:1782107608.373130:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+10:2370:x1868674447295872:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107608.373229:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+10:2370:x1868674447295872:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 104us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107608.373237:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 512 00000100:00100000:3.0:1782107608.373396:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447295744 00000100:00100000:3.0:1782107608.373402:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447295744 00000100:00100000:3.0:1782107608.373440:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 445 00000100:00100000:3.0:1782107608.373448:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447295744:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107608.373475:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447295744:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 29us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107608.373481:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 445 00000100:00100000:1.0:1782107608.384193:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107608.384334:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447296000 00000100:00100000:0.0:1782107608.384345:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447296000 00000100:00100000:0.0:1782107608.384579:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 43 00000100:00100000:0.0:1782107608.384591:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2369:x1868674447296000:12345-192.168.202.26@tcp:9:kworker.0 00000020:00000080:0.0:1782107608.384644:0:6578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc2d453a189c7cf1e 00000100:00080000:0.0:1782107608.384653:0:6578:0:(import.c:65:import_set_state_nolock()) ffff8abec1335800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782107608.384704:0:6578:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967307 00000100:00100000:0.0:1782107608.385062:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+2:2369:x1868674447296000:12345-192.168.202.26@tcp:9:kworker.0 Request processed in 473us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107608.385070:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 43 00010000:00010000:1.0:1782107608.385191:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782107608.386049:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782107608.451361:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782107608.679120:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000001:02000400:1.0:1782107609.379524:0:31898:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_28a: @@@@@@ FAIL: setstripe failed 00010000:00010000:0.0:1782107609.481403:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107610.179449:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472514560:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.179523:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107610.179578:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472515072:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.179626:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107610.179657:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782107610.179663:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3327:1868674472514432:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.179693:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107610.179718:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1868674472514944:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.179739:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107610.179772:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472514560 00000100:00100000:1.0:1782107610.179781:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472514560 00000100:00100000:1.0:1782107610.179825:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472514944 00000100:00100000:1.0:1782107610.179828:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472514944 00000100:00100000:1.0:1782107610.179852:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1782107610.179860:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd810b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472514560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.179911:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd810b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3327:x1868674472514560:12345-0@lo:400:kworker.0 Request processed in 52us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107610.179918:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1782107610.179932:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1782107610.179937:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1868674472514944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.179955:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3327:x1868674472514944:12345-0@lo:400:kworker.0 Request processed in 19us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107610.179958:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1782107610.179990:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472515072 00000100:00100000:1.0:1782107610.179992:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472515072 00000100:00100000:1.0:1782107610.180012:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1782107610.180016:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472515072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180034:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472515072:12345-0@lo:400:kworker.0 Request processed in 18us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107610.180044:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1782107610.180057:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472514432 00000100:00100000:1.0:1782107610.180059:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472514432 00000100:00100000:1.0:1782107610.180073:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1782107610.180076:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3327:x1868674472514432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180095:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3327:x1868674472514432:12345-0@lo:400:kworker.0 Request processed in 19us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107610.180099:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1782107610.180134:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3327:1868674472514432:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180143:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3327:1868674472514944:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180148:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3327:1868674472514560:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180153:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472515072:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180182:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472514816:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180203:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107610.180223:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782107610.180228:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1868674472514688:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180248:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107610.180273:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472514816 00000100:00100000:1.0:1782107610.180277:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472514816 00000100:00100000:1.0:1782107610.180301:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1782107610.180307:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472514816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180334:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472514816:12345-0@lo:400:kworker.0 Request processed in 28us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107610.180338:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1782107610.180363:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472514816:0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180372:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472514688 00000100:00100000:1.0:1782107610.180374:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472514688 00000100:00100000:1.0:1782107610.180387:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1782107610.180390:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeaffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1868674472514688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107610.180410:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeaffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1868674472514688:12345-0@lo:400:kworker.0 Request processed in 20us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107610.180414:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1782107610.180427:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3325:1868674472514688:0@lo:400:kworker.0 00000100:00080000:2.0:1782107610.180657:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782107610.180661:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782107610.180664:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782107610.497745:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1401 lines, 1401 kept, 0 dropped, 0 bad.