00010000:00010000:1.0F:1782107135.235712:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107136.064568:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472414336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107136.064687:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107136.064751:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472414336 00000100:00100000:1.0:1782107136.064758:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472414336 00000100:00100000:1.0:1782107136.064803:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782107136.064828:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb420a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472414336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107136.064864:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107136.064907:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb420a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472414336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107136.064915:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1782107136.064936:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107136.064992:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472414336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0F:1782107136.256236:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1782107136.596888:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107136.596962:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447206528 00000100:00100000:1.0:1782107136.597028:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447206528 00000100:00100000:1.0:1782107136.597180:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:1.0:1782107136.597190:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:12515:x1868674447206528:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:1.0:1782107136.597211:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107136.597233:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec6086ee expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.597352:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.597366:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.597378:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782107136.597786:0:5807:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782107136.597791:0:5807:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782107136.597883:0:5807:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.597910:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086ee expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.597924:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086ee expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.597934:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:1.0:1782107136.597938:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782107136.597941:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe81406c00, rc 0) 00000100:00100000:1.0:1782107136.598026:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:12515:x1868674447206528:12345-192.168.202.26@tcp:101:rm.0 Request processed in 838us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107136.598033:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00080000:3.0:1782107136.601128:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107136.613660:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107136.613782:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447206656 00000100:00100000:0.0:1782107136.613794:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447206656 00000100:00100000:0.0:1782107136.613865:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:0.0:1782107136.613876:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+6:12515:x1868674447206656:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:0.0:1782107136.613897:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107136.613926:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5000/0xc2d453a189c7be23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec6086f5 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614015:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614030:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614040:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614055:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614063:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614069:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614474:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a4e00/0xc2d453a189c7be38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614484:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a4e00/0xc2d453a189c7be38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614501:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a4e00/0xc2d453a189c7be38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107136.614529:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 0 00000004:00200000:0.0:1782107136.614533:0:7463:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782107136.614550:0:7463:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a4e00/0xc2d453a189c7be38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614573:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a4e00/0xc2d453a189c7be38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614581:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614587:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614594:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614599:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe991a5c00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107136.614603:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614610:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614621:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:0.0:1782107136.614624:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107136.614629:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614643:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5c00/0xc2d453a189c7be2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614655:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614661:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614666:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614671:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe991a5200 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107136.614674:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614680:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614687:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47358950 (ffff8abe89048b00) 00010000:00010000:0.0:1782107136.614690:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107136.614692:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614698:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5200/0xc2d453a189c7be31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614729:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a5000/0xc2d453a189c7be23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086f5 expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614742:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a4e00/0xc2d453a189c7be38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086f5 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107136.614756:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abe89048100) 00010000:00010000:0.0:1782107136.614758:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782107136.614761:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe991a4e00, rc 0) 00000100:00100000:0.0:1782107136.614840:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+7:12515:x1868674447206656:12345-192.168.202.26@tcp:101:rm.0 Request processed in 965us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107136.614848:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:0.0:1782107136.632584:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107136.632677:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447206912 00000100:00100000:3.0:1782107136.632687:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447206912 00000100:00100000:3.0:1782107136.632739:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:3.0:1782107136.632749:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+7:12515:x1868674447206912:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:3.0:1782107136.632815:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782107136.632844:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe991a4e00/0xc2d453a189c7be38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086f5 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.632861:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abe89048100) 00010000:00010000:3.0:1782107136.632877:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086ee expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.632885:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:3.0:1782107136.632891:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782107136.632916:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.632929:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.632937:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.632949:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.632955:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.632996:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.634171:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.634186:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.634194:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641208:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641229:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641242:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641251:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641268:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641274:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641295:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782107136.641318:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641324:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641342:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641347:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f5000 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:1.0:1782107136.641351:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641359:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.641370:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abe86b54f00) 00010000:00010000:1.0:1782107136.641374:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782107136.641379:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.641475:0:5796:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107136.641482:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.641499:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81406800 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:3.0:1782107136.641502:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.641509:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.641518:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8abe86b54f00) 00010000:00010000:3.0:1782107136.641520:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782107136.641523:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.641528:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7be54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107136.641563:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107136.641566:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107136.641567:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107136.642122:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5000/0xc2d453a189c7be4d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.642149:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.642164:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.642169:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.642175:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f4400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:1.0:1782107136.642178:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.642184:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.642194:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54d00) 00010000:00010000:1.0:1782107136.642197:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107136.642200:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107136.642206:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7be3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782107136.642218:0:5809:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a58a77e1 reply state 00000000d2a6afa8 transno 4294967320 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107136.642226:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782107136.642318:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+7:12515:x1868674447206912:12345-192.168.202.26@tcp:36:rm.0 Request processed in 9566us (9736us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1782107136.642326:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 56 00010000:00010000:2.0F:1782107136.660744:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107136.660775:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107136.660782:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107136.660788:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f5400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107136.660792:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107136.660799:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107136.660826:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47358950 (ffff8abe86b54900) 00010000:00010000:2.0:1782107136.660830:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107136.660835:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107136.660841:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7be46 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x47358950 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107137.090162:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472414464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107137.090358:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107137.090682:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472414464 00000100:00100000:0.0:1782107137.090691:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472414464 00000100:00100000:0.0:1782107137.090751:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782107137.090760:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb420ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472414464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107137.090796:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107137.090861:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb420ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472414464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107137.090869:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1782107137.091161:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abeb3ed1180 x1868674472414464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782107137.093602:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107137.095374:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472414464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782107137.280206:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107137.326804:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107137.326847:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107137.326912:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447207168 00000100:00100000:3.0:1782107137.326921:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447207168 00000100:00100000:3.0:1782107137.326994:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 148 00000100:00100000:3.0:1782107137.327004:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2372:x1868674447207168:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107137.327070:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2372:x1868674447207168:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 69us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107137.327078:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 148 00000100:00100000:3.0:1782107137.327096:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447207040 00000100:00100000:3.0:1782107137.327099:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447207040 00000100:00100000:3.0:1782107137.327116:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 261 00000100:00100000:3.0:1782107137.327121:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447207040:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107137.327141:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447207040:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 20us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107137.327147:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 261 00010000:00010000:3.0:1782107138.305022:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107139.136324:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472414592:0@lo:400:kworker.0 00000100:00100000:2.0:1782107139.136340:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472414720:0@lo:400:kworker.0 00000100:00100000:1.0:1782107139.141010:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107139.141068:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472415104:0@lo:400:kworker.0 00000100:00100000:1.0:1782107139.141108:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107139.141151:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472414592 00000100:00100000:1.0:1782107139.141160:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472414592 00000100:00100000:1.0:1782107139.141207:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782107139.141215:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472414592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107139.141266:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472414592:12345-0@lo:400:kworker.0 Request processed in 51us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107139.141273:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782107139.141306:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472415104 00000100:00100000:1.0:1782107139.141310:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472415104 00000100:00100000:1.0:1782107139.141345:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782107139.141352:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472415104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107139.141384:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472415104:12345-0@lo:400:kworker.0 Request processed in 32us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107139.141390:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1782107139.141408:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107139.141882:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472414592:0@lo:400:kworker.0 00000100:00100000:1.0:1782107139.141899:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472415104:0@lo:400:kworker.0 00000100:00100000:0.0:1782107139.142171:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472414976:0@lo:400:kworker.0 00000100:00100000:0.0:1782107139.142211:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107139.142250:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107139.142257:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472414848:0@lo:400:kworker.0 00000100:00100000:0.0:1782107139.142278:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107139.142309:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472414848 00000100:00100000:0.0:1782107139.142313:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472414848 00000100:00100000:0.0:1782107139.142346:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782107139.142352:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472414848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107139.142401:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472414848:12345-0@lo:400:kworker.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107139.142419:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782107139.142460:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472414848:0@lo:400:kworker.0 00000100:00100000:2.0:1782107139.142762:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107139.142860:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472415232:0@lo:400:kworker.0 00000100:00100000:2.0:1782107139.142950:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107139.143059:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472414976 00000100:00100000:2.0:1782107139.143063:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472414976 00000100:00100000:2.0:1782107139.143093:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472415232 00000100:00100000:2.0:1782107139.143096:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472415232 00000100:00100000:2.0:1782107139.143116:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782107139.143123:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472414976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107139.143159:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472414976:12345-0@lo:400:kworker.0 Request processed in 36us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107139.143166:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782107139.143180:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782107139.143186:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd810b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472415232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107139.143215:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd810b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472415232:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107139.143220:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782107139.143316:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472415232:0@lo:400:kworker.0 00000100:00100000:0.0:1782107139.143462:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472414720 00000100:00100000:0.0:1782107139.143465:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472414720 00000100:00100000:0.0:1782107139.143487:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782107139.143493:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472414720:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782107139.143633:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107139.143637:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782107139.143639:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782107139.144160:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe85bc6300 x1868674472414976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107139.144180:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472414976:0@lo:400:kworker.0 00000100:00100000:0.0:1782107139.144604:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472414720:12345-0@lo:400:kworker.0 Request processed in 37us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107139.144614:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782107139.144647:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472414720:0@lo:400:kworker.0 00010000:00010000:3.0:1782107139.329713:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107140.362032:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782107140.728649:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000100:00100000:1.0:1782107141.197147:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107141.197167:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472415360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107141.197231:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107141.197307:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472415360 00000100:00100000:1.0:1782107141.197316:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472415360 00000100:00100000:1.0:1782107141.197427:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782107141.197436:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472415360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107141.197468:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107141.197508:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472415360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107141.197514:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1782107141.197533:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107141.197565:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472415360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107141.376616:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107142.208401:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782107142.208425:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472415488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107142.208500:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107142.208608:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472415488 00000100:00100000:3.0:1782107142.208618:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472415488 00000100:00080000:0.0:1782107142.208685:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107142.208686:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782107142.208697:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd810b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472415488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782107142.208734:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107142.208836:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd810b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472415488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107142.208843:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1782107142.208898:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef20380 x1868674472415488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107142.208915:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472415488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782107142.403560:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107142.449436:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107142.449489:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107142.449636:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447207424 00000100:00100000:2.0:1782107142.449647:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447207424 00000100:00100000:2.0:1782107142.449705:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 152 00000100:00100000:2.0:1782107142.449725:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447207424:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107142.449824:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447207424:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 102us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107142.449833:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 152 00000100:00080000:2.0:1782107142.449855:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107142.450021:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447207296 00000100:00100000:2.0:1782107142.450025:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447207296 00000100:00100000:2.0:1782107142.450051:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 263 00000100:00100000:2.0:1782107142.450059:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447207296:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107142.450088:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447207296:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107142.450095:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 263 00010000:00010000:3.0:1782107143.425764:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107144.256377:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472415616:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.256453:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107144.256517:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472416128:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.256542:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107144.256568:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782107144.256574:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472415744:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.256606:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107144.256622:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472416256:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.256680:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107144.256704:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472416000:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.256723:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107144.256751:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107144.256756:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472415872:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.256774:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107144.256799:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472416128 00000100:00100000:1.0:1782107144.256805:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472416128 00000100:00100000:1.0:1782107144.256846:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472415744 00000100:00100000:1.0:1782107144.256848:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472415744 00000100:00100000:1.0:1782107144.256858:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472415872 00000100:00100000:1.0:1782107144.256860:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472415872 00000100:00100000:1.0:1782107144.256874:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782107144.256881:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472416128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.256925:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472416128:12345-0@lo:400:kworker.0 Request processed in 44us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107144.256932:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782107144.256947:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782107144.256952:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472415744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.257004:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472415744:12345-0@lo:400:kworker.0 Request processed in 20us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107144.257010:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782107144.257175:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782107144.257182:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472415872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.257226:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472415872:12345-0@lo:400:kworker.0 Request processed in 45us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107144.257231:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782107144.257269:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472416256 00000100:00100000:1.0:1782107144.257273:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472416256 00000100:00100000:1.0:1782107144.257297:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472416000 00000100:00100000:1.0:1782107144.257299:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472416000 00000100:00100000:1.0:1782107144.257316:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782107144.257321:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb420b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472416256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.257347:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb420b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472416256:12345-0@lo:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107144.257353:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782107144.257362:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782107144.257367:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472416000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.257386:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472416000:12345-0@lo:400:kworker.0 Request processed in 19us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107144.257391:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1782107144.257411:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782107144.257414:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107144.257417:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107144.257450:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472415872:0@lo:400:kworker.0 00010000:00080000:1.0:1782107144.257461:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe85bc4700 x1868674472416000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107144.257471:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472416000:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.257510:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472415744:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.257527:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472416256:0@lo:400:kworker.0 00000100:00100000:1.0:1782107144.257535:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472416128:0@lo:400:kworker.0 00000100:00100000:3.0:1782107144.257707:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472415616 00000100:00100000:3.0:1782107144.257712:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472415616 00000100:00100000:3.0:1782107144.257756:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1782107144.257763:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472415616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107144.257797:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472415616:12345-0@lo:400:kworker.0 Request processed in 36us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107144.257803:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1782107144.259146:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472415616:0@lo:400:kworker.0 00010000:00010000:2.0:1782107144.448803:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107145.497216:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107146.304681:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107146.304704:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472416384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107146.304800:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107146.305733:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472416384 00000100:00100000:1.0:1782107146.305744:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472416384 00000100:00100000:1.0:1782107146.305833:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782107146.305843:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472416384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107146.305880:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107146.305951:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472416384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107146.306125:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472416384:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782107146.306294:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107146.306398:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1782107146.500296:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107147.337783:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107147.337813:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472416512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107147.337903:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107147.338160:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472416512 00000100:00100000:3.0:1782107147.338169:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472416512 00000100:00100000:3.0:1782107147.338228:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782107147.338238:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472416512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782107147.338272:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107147.338331:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472416512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107147.338339:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1782107147.338385:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef23800 x1868674472416512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107147.338405:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472416512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782107147.338948:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782107147.520082:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107147.573442:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107147.575419:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107147.577184:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447207680 00000100:00100000:1.0:1782107147.577200:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447207680 00000100:00100000:1.0:1782107147.577321:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 156 00000100:00100000:1.0:1782107147.577334:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447207680:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107147.577427:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447207680:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 96us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107147.577435:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 156 00000100:00080000:2.0:1782107147.577648:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107147.579519:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447207552 00000100:00100000:3.0:1782107147.579534:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447207552 00000100:00100000:2.0:1782107147.583045:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 265 00000100:00100000:2.0:1782107147.583063:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447207552:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107147.585342:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447207552:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 2272us (11899us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107147.585357:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 265 00000001:02000400:1.0:1782107147.709320:0:14236:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1e: setstripe with EC inheriting to second component ========================================================== 01:45:45 (1782107145) 00010000:00010000:0.0:1782107148.544185:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107149.173611:0:14284:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1e needs >= 6 OSTs 00000100:00100000:2.0:1782107149.376764:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472416896:0@lo:400:kworker.0 00000100:00100000:1.0:1782107149.376775:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472417024:0@lo:400:kworker.0 00000100:00100000:3.0:1782107149.376886:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb420b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472416640:0@lo:400:kworker.0 00000100:00100000:2.0:1782107149.376936:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107149.376953:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107149.377033:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472416896 00000100:00100000:2.0:1782107149.377039:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472416896 00000100:00100000:0.0:1782107149.377043:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472416768:0@lo:400:kworker.0 00000100:00100000:0.0:1782107149.377074:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107149.377103:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472416768 00000100:00100000:2.0:1782107149.377106:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472416768 00000100:00100000:0.0:1782107149.377110:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472417280:0@lo:400:kworker.0 00000100:00100000:2.0:1782107149.377125:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782107149.377141:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472416896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107149.377148:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107149.377199:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472416896:12345-0@lo:400:kworker.0 Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107149.377207:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782107149.377225:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782107149.377239:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472416768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107149.377282:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472416768:12345-0@lo:400:kworker.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00080000:2.0:1782107149.377327:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107149.377361:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472416896:0@lo:400:kworker.0 00000100:00100000:1.0:1782107149.377706:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107149.377744:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472417280 00000100:00100000:1.0:1782107149.377749:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472417280 00000100:00100000:2.0:1782107149.377751:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472417024 00000100:00100000:2.0:1782107149.377757:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472417024 00000100:00100000:1.0:1782107149.377787:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782107149.377802:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472417280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107149.377835:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472417280:12345-0@lo:400:kworker.0 Request processed in 35us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107149.377852:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782107149.377863:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782107149.377874:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472417024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107149.377890:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472416640 00000100:00100000:1.0:1782107149.377895:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472416640 00000100:00100000:2.0:1782107149.377914:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472417024:12345-0@lo:400:kworker.0 Request processed in 45us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107149.377920:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782107149.377923:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1782107149.377938:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782107149.377940:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107149.377944:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472416640:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1782107149.377955:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abeb4209880 x1868674472417024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107149.377964:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472417024:0@lo:400:kworker.0 00000100:00100000:1.0:1782107149.378001:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472416640:12345-0@lo:400:kworker.0 Request processed in 70us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107149.378007:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1782107149.378049:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472416768:0@lo:400:kworker.0 00000100:00100000:1.0:1782107149.378057:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472417280:0@lo:400:kworker.0 00000100:00100000:0.0:1782107149.382722:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782107149.382890:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb420b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472416640:0@lo:400:kworker.0 00000100:00100000:3.0:1782107149.382904:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472417152:0@lo:400:kworker.0 00000100:00100000:3.0:1782107149.382965:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107149.384859:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472417152 00000100:00100000:2.0:1782107149.384872:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472417152 00000100:00100000:2.0:1782107149.384961:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782107149.385009:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472417152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107149.385100:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472417152:12345-0@lo:400:kworker.0 Request processed in 92us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107149.385107:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782107149.385154:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472417152:0@lo:400:kworker.0 00000100:00080000:3.0:1782107149.386061:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782107149.575503:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107150.592784:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107151.164827:0:14334:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1f: setstripe with different EC for different components ========================================================== 01:45:49 (1782107149) 00000100:00100000:3.0:1782107151.426510:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107151.426532:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472417408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107151.426598:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107151.426661:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472417408 00000100:00100000:3.0:1782107151.426678:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472417408 00000100:00100000:3.0:1782107151.426734:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782107151.426744:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472417408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107151.426780:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107151.427187:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472417408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 444us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107151.427210:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1782107151.427235:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107151.427287:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472417408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107151.617401:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107152.450178:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472417536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107152.450270:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107152.450810:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472417536 00000100:00100000:0.0:1782107152.450821:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472417536 00000100:00100000:0.0:1782107152.450891:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782107152.450901:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472417536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107152.450939:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107152.451035:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472417536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107152.451042:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1782107152.451104:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782107152.451146:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebfc4ce00 x1868674472417536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107152.451164:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472417536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782107152.646259:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107152.687046:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107152.687156:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447207808 00000100:00100000:3.0:1782107152.687167:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447207808 00000100:00100000:3.0:1782107152.687222:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 267 00000100:00100000:3.0:1782107152.687232:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447207808:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107152.687317:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447207808:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 87us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107152.687324:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 267 00000100:00100000:0.0:1782107152.696796:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107152.696903:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447207936 00000100:00100000:3.0:1782107152.696918:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447207936 00000100:00100000:3.0:1782107152.697028:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 160 00000100:00100000:3.0:1782107152.697042:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447207936:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107152.697148:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447207936:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 110us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107152.697156:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 160 00000100:00080000:0.0:1782107152.697360:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1782107152.853733:0:14382:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1f needs >= 6 OSTs 00010000:00010000:2.0:1782107153.664450:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107154.505269:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782107154.505293:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472417664:0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.505367:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107154.505615:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472417664 00000100:00100000:0.0:1782107154.505624:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472417664 00000100:00100000:0.0:1782107154.505692:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782107154.505702:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472417664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.505756:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472417664:12345-0@lo:400:kworker.0 Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107154.505763:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782107154.505807:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472417664:0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.505848:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472417792:0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.505875:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107154.505946:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472417920:0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.505969:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107154.506028:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472417792 00000100:00100000:0.0:1782107154.506031:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472417792 00000100:00100000:0.0:1782107154.506057:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472417920 00000100:00100000:0.0:1782107154.506060:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472417920 00000100:00100000:0.0:1782107154.506087:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782107154.506093:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472417792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.506130:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472417792:12345-0@lo:400:kworker.0 Request processed in 37us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107154.506137:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782107154.506149:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782107154.506155:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472417920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.506184:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472417920:12345-0@lo:400:kworker.0 Request processed in 30us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107154.506190:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1782107154.506219:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107154.506477:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472417792:0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.506504:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472417920:0@lo:400:kworker.0 00000100:00100000:3.0:1782107154.506559:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472418048:0@lo:400:kworker.0 00000100:00100000:3.0:1782107154.506596:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107154.506674:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472418176:0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.506698:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107154.506723:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472418176 00000100:00100000:0.0:1782107154.506727:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472418176 00000100:00100000:0.0:1782107154.506763:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782107154.506769:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472418176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.506801:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472418176:12345-0@lo:400:kworker.0 Request processed in 32us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107154.506814:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1782107154.506829:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107154.506845:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472418176:0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.506874:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472418304:0@lo:400:kworker.0 00000100:00100000:0.0:1782107154.506895:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107154.506920:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472418048 00000100:00100000:0.0:1782107154.506924:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472418048 00000100:00100000:0.0:1782107154.506950:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472418304 00000100:00100000:0.0:1782107154.506953:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472418304 00000100:00100000:0.0:1782107154.506990:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782107154.506997:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472418048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107154.508060:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782107154.508075:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472418304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107154.508135:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472418304:12345-0@lo:400:kworker.0 Request processed in 64us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107154.508143:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782107154.509510:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472418048:12345-0@lo:400:kworker.0 Request processed in 2506us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107154.509522:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1782107154.509558:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782107154.509562:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107154.509609:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472418304:0@lo:400:kworker.0 00010000:00080000:3.0:1782107154.510892:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebfc4ed80 x1868674472418048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107154.510907:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472418048:0@lo:400:kworker.0 00000001:02000400:0.0:1782107154.513205:0:14430:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1g: setstripe with different parity counts ========================================================== 01:45:53 (1782107153) 00000100:00100000:3.0:1782107154.642726:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107154.645234:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447208064 00000100:00100000:1.0:1782107154.645249:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447208064 00000100:00100000:1.0:1782107154.645341:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:1.0:1782107154.645352:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:13387:x1868674447208064:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1782107154.645374:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1782107154.645591:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782107154.645658:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec6086fc expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.645726:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407800/0xc2d453a189c7be62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.645741:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407800/0xc2d453a189c7be62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.645770:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407800/0xc2d453a189c7be62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782107154.646147:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782107154.646152:0:7463:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782107154.646234:0:7463:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407800/0xc2d453a189c7be62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.646264:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086fc expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.646279:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407800/0xc2d453a189c7be62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086fc expref: 6 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.646288:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6aa00) 00010000:00010000:1.0:1782107154.646291:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782107154.646294:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe81407800, rc 0) 00000100:00100000:1.0:1782107154.646366:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+6:13387:x1868674447208064:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1015us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107154.646373:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:1.0:1782107154.651228:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107154.651297:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447208192 00000100:00100000:2.0:1782107154.651307:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447208192 00000100:00100000:2.0:1782107154.651367:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:2.0:1782107154.651377:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:13387:x1868674447208192:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1782107154.651397:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107154.651417:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349000/0xc2d453a189c7be69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608703 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651487:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651512:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651524:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651543:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651551:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651558:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651846:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651925:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651932:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651938:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107154.651942:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651950:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.651962:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6aa00) 00010000:00010000:2.0:1782107154.652027:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107154.652033:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652040:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7be70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652050:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652055:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652059:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652064:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348000 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107154.652066:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652071:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652079:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddb0fc11 (ffff8abe898b2a00) 00010000:00010000:2.0:1782107154.652081:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107154.652083:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652088:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7be77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652117:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349000/0xc2d453a189c7be69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608703 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652137:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6aa00) 00010000:00010000:2.0:1782107154.652139:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107154.652144:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349000/0xc2d453a189c7be69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608703 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.652153:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1349000, rc 0) 00000100:00100000:2.0:1782107154.652215:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:13387:x1868674447208192:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 839us (996us total) trans 0 rc 301/301 00000100:00100000:2.0:1782107154.652223:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:0.0:1782107154.665748:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107154.665969:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447208448 00000100:00100000:1.0:1782107154.665996:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447208448 00000100:00100000:1.0:1782107154.666050:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:1.0:1782107154.666060:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:13387:x1868674447208448:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1782107154.666080:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107154.666083:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782107154.666126:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407800/0xc2d453a189c7be62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6086fc expref: 6 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.666143:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6aa00) 00010000:00010000:1.0:1782107154.666153:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782107154.666167:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be7e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec60870a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.666487:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.666500:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.666509:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.666520:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.666525:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.666530:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667489:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667504:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667512:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782107154.667529:0:5809:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782107154.667556:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667564:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667571:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667577:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81406a00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:1.0:1782107154.667581:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667588:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667597:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a500) 00010000:00010000:1.0:1782107154.667600:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107154.667603:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667608:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406a00/0xc2d453a189c7be85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782107154.667617:0:5809:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005189776a reply state 00000000888fef10 transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107154.667626:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782107154.667669:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7be7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667696:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.667703:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abe84d6a400) 00010000:00010000:1.0:1782107154.667706:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782107154.667708:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe81406400, rc 0) 00000100:00100000:1.0:1782107154.667788:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+8:13387:x1868674447208448:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1729us (2047us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1782107154.667797:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 59 00010000:00010000:2.0:1782107154.671402:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.671421:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.671430:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.671437:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81407a00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107154.671442:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.671450:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.671466:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddb0fc11 (ffff8abe84d6af00) 00010000:00010000:2.0:1782107154.671470:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107154.671475:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.671489:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7be8c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107154.683311:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107154.683391:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447208704 00000100:00100000:2.0:1782107154.683402:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447208704 00000100:00100000:2.0:1782107154.683463:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:2.0:1782107154.683473:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+7:13387:x1868674447208704:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1782107154.683496:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107154.683516:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349000/0xc2d453a189c7bea1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608711 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.683614:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.683629:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.683639:0:5807:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.683689:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107154.683703:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 8 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107154.683716:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4209180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1868674472418432:192.168.202.26@tcp:104: 00000100:00100000:2.0:1782107154.683802:0:5807:0:(client.c:2692:ptlrpc_set_wait()) set ffff8abe981b1480 going to sleep for 11 seconds 00000100:00100000:3.0:1782107154.692543:0:5807:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4209180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1868674472418432:192.168.202.26@tcp:104: 00010000:00010000:3.0:1782107154.692583:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107154.695584:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00010000:00010000:0.0:1782107154.700285:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107154.703011:0:5793:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447208832 00000100:00100000:1.0:1782107154.703027:0:5793:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447208832 00010000:00010000:1.0:1782107154.703078:0:5793:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 9 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107154.703124:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:1.0:1782107154.703135:0:5793:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+9:2373:x1868674447208832:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782107154.703150:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782107154.703156:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 9 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.703170:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 9 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.703192:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406400/0xc2d453a189c7be93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60870a expref: 9 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.704007:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abe84d6a400) 00010000:00010000:1.0:1782107154.704015:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.704025:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.704032:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107154.704060:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107154.704119:0:5793:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+8:2373:x1868674447208832:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 985us (8545us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107154.704127:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 33 00010000:00010000:3.0:1782107154.705651:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.705664:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107154.705687:0:5807:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1782107154.707091:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.707104:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.707113:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.707119:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348000 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107154.707124:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.707131:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.707146:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abe84d6a400) 00010000:00010000:3.0:1782107154.707149:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782107154.707154:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.707172:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348000/0xc2d453a189c7bea8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.708302:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349000/0xc2d453a189c7bea1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608711 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.708320:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe898b2a00) 00010000:00010000:3.0:1782107154.708323:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782107154.708330:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349000/0xc2d453a189c7bea1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608711 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107154.708347:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1349000, rc 0) 00000100:00100000:3.0:1782107154.708425:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:13387:x1868674447208704:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 24952us (25124us total) trans 0 rc 301/301 00000100:00100000:3.0:1782107154.708434:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:0.0:1782107154.721402:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107154.721477:0:5811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447209088 00000100:00100000:2.0:1782107154.721487:0:5811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447209088 00000100:00100000:2.0:1782107154.721547:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:2.0:1782107154.721558:0:5811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abea98fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:13387:x1868674447209088:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1782107154.721814:0:5811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abea98fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:13387:x1868674447209088:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 257us (418us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1782107154.721822:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 10 00010000:00010000:1.0:1782107155.712156:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782107156.059177:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967321 is committed 00000001:00080000:3.0:1782107156.059196:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:02000400:2.0:1782107156.225301:0:14480:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_1g: @@@@@@ FAIL: setstripe failed 00000100:00100000:1.0:1782107156.544337:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107156.544362:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472418560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107156.544444:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107156.544671:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472418560 00000100:00100000:3.0:1782107156.544680:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472418560 00000100:00100000:3.0:1782107156.544742:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782107156.544750:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472418560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107156.544780:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107156.544819:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472418560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107156.544825:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1782107156.544881:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107156.545038:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472418560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782107156.739121:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107157.572296:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107157.572330:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472418688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107157.572420:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107157.572519:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472418688 00000100:00100000:0.0:1782107157.572528:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472418688 00000100:00080000:2.0:1782107157.572597:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107157.572597:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782107157.572607:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472418688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107157.572666:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107157.572730:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472418688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107157.572737:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1782107157.573602:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebfc4ca80 x1868674472418688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107157.573636:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472418688:0@lo:13:osp-pre-0-0.0 Debug log: 763 lines, 763 kept, 0 dropped, 0 bad.