00010000:00010000:2.0F:1782487603.503102:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1782487604.142146:0:290842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.142164:0:290842:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487604.142237:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294453376:192.168.202.121@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487604.148157:0:2360:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148175:0:2360:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148183:0:2360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148190:0:2360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148200:0:2360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148206:0:2360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aedc16c00 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487604.148211:0:2360:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148218:0:2360:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148226:0:2360:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x20e400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148233:0:2360:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1782487604.148246:0:2360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487604.148254:0:2360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc16c00/0x43f633357a478516 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 290842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487604.148294:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294453376:192.168.202.121@tcp:63:ll_sa.0 00010000:00010000:2.0:1782487604.525858:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0F:1782487605.165883:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8ce:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487605.165907:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487605.165953:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8ce:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487605.165979:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x920:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487605.166036:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487605.166062:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x920:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487605.166080:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x924:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487605.166085:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487605.166100:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x924:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487605.166116:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x932:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487605.166120:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487605.166135:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x932:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487605.166163:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x95b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487605.166168:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487605.166185:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x95b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1782487605.550391:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1782487605.677875:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8d0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487605.677886:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00010000:00010000:2.0:1782487605.677894:0:291235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.677908:0:291235:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1782487605.677929:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8d0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487605.677947:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8d6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487605.677950:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487605.677962:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8d6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1782487605.677979:0:2363:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782487605.677996:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294453504:192.168.202.121@tcp:63:ll_sa.0 00000080:00200000:2.0:1782487605.678030:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8d3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678038:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678086:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8d3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678117:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8d8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678123:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678149:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8d8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678170:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8d7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678175:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678195:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8d7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678214:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8da:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678218:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678236:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8da:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678270:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8e4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678276:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678299:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8e4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678322:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8ea:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678327:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678347:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8ea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678366:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8eb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678371:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678388:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8eb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678407:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8ec:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678425:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678447:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8ec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678466:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8ef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678471:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678488:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8ef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678506:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8f8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678510:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678528:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8f8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678546:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x900:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678551:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678569:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x900:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678586:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x8fe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678591:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678610:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x8fe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678629:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x902:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678633:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678651:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x902:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678668:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x909:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678672:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678690:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x909:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678707:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x914:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678712:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678782:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x914:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678803:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x91f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678808:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678847:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x91f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678872:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x922:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678882:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678904:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x922:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678923:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x921:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678927:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678945:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x921:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.678963:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x928:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.678967:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.678985:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x928:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679003:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x929:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679007:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679024:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x929:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679042:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x935:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679047:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679064:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x935:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679082:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x939:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679086:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679103:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x939:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679122:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x93d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679126:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679144:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x93d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679161:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x93f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679166:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679183:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x93f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679201:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x942:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679206:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679223:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x942:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679241:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x941:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679265:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679288:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x941:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679307:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x94a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679311:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679329:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x94a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679348:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x94f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679352:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679369:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x94f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679388:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x94e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679392:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679409:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x94e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679427:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x95c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679431:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679449:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x95c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679467:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x95d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679471:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679488:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x95d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679507:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x961:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679511:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679528:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x961:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679546:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x962:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679550:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679567:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x962:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679585:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x963:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679589:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679607:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x963:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679624:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x966:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679634:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679655:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x966:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679674:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x965:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679678:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679696:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x965:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679714:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x974:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679739:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679760:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x974:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1782487605.679779:0:295207:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x977:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1782487605.679783:0:295207:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1782487605.679802:0:295207:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x977:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1782487605.681097:0:2363:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681110:0:2363:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681118:0:2363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681125:0:2363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681133:0:2363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681139:0:2363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac524ca00 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:2.0:1782487605.681143:0:2363:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x206400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681162:0:2363:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x206400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681170:0:2363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x20e400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681177:0:2363:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1782487605.681182:0:2363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487605.681189:0:2363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524ca00/0x43f633357a47851d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 291235 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487605.681215:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294453504:192.168.202.121@tcp:63:ll_sa.0 00000100:00100000:2.0:1782487606.192705:0:2362:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487606.192757:0:2362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60894528-77cf-40cf-92ce-b54cc4bbae30:2362:1869066294453632:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1782487606.193202:0:2363:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782487606.193212:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294453760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1782487606.193297:0:2362:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487606.193308:0:2362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:838f7623-bf1c-484f-8afd-fb26a1863ad0:2362:1869066294453888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1782487606.193341:0:2363:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782487606.193347:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294454016:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1782487606.193405:0:2362:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782487606.193414:0:2362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2362:1869066294454144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1782487606.193465:0:2362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2362:1869066294454272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1782487606.193609:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294454400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1782487606.194389:0:2362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:60894528-77cf-40cf-92ce-b54cc4bbae30:2362:1869066294453632:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1782487606.195464:0:2362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2362:1869066294454272:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1782487606.195472:0:2362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2362:1869066294454144:192.168.202.121@tcp:400:kworker.0 00000100:00100000:2.0:1782487606.195485:0:2362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:838f7623-bf1c-484f-8afd-fb26a1863ad0:2362:1869066294453888:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1782487606.195530:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294453760:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1782487606.195539:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294454400:192.168.202.121@tcp:400:kworker.0 00000100:00100000:3.0:1782487606.195545:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294454016:192.168.202.121@tcp:400:kworker.0 00010000:00010000:1.0F:1782487606.574365:0:261169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.701925:0:291571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782487606.701942:0:291571:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.702285:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6af8188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294454528:192.168.202.121@tcp:63:ll_sa.0 00010000:00010000:0.0:1782487606.708186:0:2361:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708203:0:2361:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708210:0:2361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708217:0:2361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708226:0:2361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708232:0:2361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ace09f600 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487606.708246:0:2361:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708253:0:2361:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708260:0:2361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x20e400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708282:0:2361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1782487606.708289:0:2361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.708295:0:2361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ace09f600/0x43f633357a478524 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 291571 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.708322:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6af8188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294454528:192.168.202.121@tcp:63:ll_sa.0 00000080:00200000:3.0:1782487606.839779:0:295211:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:3.0:1782487606.839804:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782487606.839824:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1782487606.839840:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1782487606.839847:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782487606.839854:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:3.0:1782487606.839857:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a442323 00000080:00010000:3.0:1782487606.839864:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a442323 from it ffff99a4c15a3b58 00010000:00010000:3.0:1782487606.839868:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1782487606.839876:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1782487606.839891:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148), inode mode 41ff mask 1 00000080:00200000:3.0:1782487606.839898:0:295211:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=8 00000080:00200008:3.0:1782487606.839912:0:295211:0:(file.c:6217:ll_getattr_dentry()) START file d77r.sanityn:[0x200000bd1:0x35:0x0](ffff8a6af0494b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1782487606.839916:0:295211:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08),name=d77r.sanityn 00000002:00010000:3.0:1782487606.839927:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x35:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782487606.839933:0:295211:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8a6aca90a400 type 13 mode 30 res 8589937617/53 (0 0) 00010000:00010000:3.0:1782487606.839972:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.839979:0:295211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.839988:0:295211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.840027:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebecb480 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294454656:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1782487606.840111:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6aee2e8000 going to sleep for 176 seconds 00000100:00100000:3.0:1782487606.850461:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebecb480 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294454656:192.168.202.121@tcp:101:rm.0 00010000:00010000:3.0:1782487606.850486:0:295211:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850501:0:295211:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850510:0:295211:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850521:0:295211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850530:0:295211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850554:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850561:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850578:0:295211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782487606.850594:0:295211:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8a6aebecb480 x1869066294454656/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 576/584 e 0 to 0 dl 1782487787 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782487606.850605:0:295211:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850614:0:295211:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8a6aca90a400 type 13 mode 4 res 8589937617/53 (0 0) 00000080:00200000:3.0:1782487606.850620:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1782487606.850636:0:295211:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x200000bd1:0x35:0x0], updating i_size 7680 00000080:00010000:3.0:1782487606.850641:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x35:0x0](ffff8a6af0494b08) for lock 0x43f633357a47852b 00000080:00010000:3.0:1782487606.850649:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x35:0x0](ffff8a6af0494b08) 00000080:00010000:3.0:1782487606.850653:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a47852b from it ffff99a4c15a3cb8 00010000:00010000:3.0:1782487606.850656:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850664:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782487606.850765:0:295211:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:3.0:1782487606.850779:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782487606.850788:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1782487606.850810:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1782487606.850817:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782487606.850822:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:3.0:1782487606.850825:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a442323 00000080:00010000:3.0:1782487606.850829:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a442323 from it ffff99a4c15a3bf8 00010000:00010000:3.0:1782487606.850832:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1782487606.850839:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1782487606.850848:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148), inode mode 41ff mask 1 00000080:00200000:3.0:1782487606.850854:0:295211:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=266 00000080:00200000:3.0:1782487606.850858:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 44 00000080:00200008:3.0:1782487606.850866:0:295211:0:(file.c:1058:ll_file_open()) START file d77r.sanityn:[0x200000bd1:0x35:0x0](ffff8a6af0494b08), flags 704400 00000002:00010000:3.0:1782487606.850879:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x35:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:3.0:1782487606.850915:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.850922:0:295211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1782487606.850940:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1782487606.850947:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6aebecb480 x1869066294454912/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1782487606.850955:0:295211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487606.850972:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebecb480 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294454912:192.168.202.121@tcp:101:rm.0 00000100:00100000:3.0:1782487606.851124:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6aee2e8000 going to sleep for 176 seconds 00000100:00100000:3.0:1782487606.859051:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebecb480 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294454912:192.168.202.121@tcp:101:rm.0 00010000:00010000:3.0:1782487606.859084:0:295211:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859097:0:295211:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859103:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859110:0:295211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859118:0:295211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859124:0:295211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af81de600 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:3.0:1782487606.859128:0:295211:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859150:0:295211:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859157:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859163:0:295211:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782487606.859169:0:295211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487606.859176:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81de600/0x43f633357a478532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782487606.859195:0:295211:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8a6aebecb480 x1869066294454912/t8589957021(8589957021) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1782487606.859208:0:295211:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8a6aebecb480 x1869066294454912/t8589957021(8589957021) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1782487606.859218:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1782487606.859251:0:295211:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x200000bd1:0x35:0x0], updating i_size 7680 00000002:00100000:3.0:1782487606.859269:0:295211:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8a6aebecb480 x1869066294454912/t8589957021(8589957021) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1782487606.859364:0:295211:0:(file.c:6217:ll_getattr_dentry()) START file d77r.sanityn:[0x200000bd1:0x35:0x0](ffff8a6af0494b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1782487606.859371:0:295211:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08),name=d77r.sanityn 00000002:00010000:3.0:1782487606.859389:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x35:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782487606.859403:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782487606.859425:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782487606.859432:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782487606.859437:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x35:0x0](ffff8a6af0494b08) 00000080:00010000:3.0:1782487606.859441:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x35:0x0](ffff8a6af0494b08) for lock 0x43f633357a47852b 00000080:00010000:3.0:1782487606.859446:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a47852b from it ffff99a4c15a3cd8 00010000:00010000:3.0:1782487606.859450:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782487606.859458:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782487606.859522:0:295211:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08) pos/size0/7680 32bit_api 0 00000002:00010000:3.0:1782487606.859534:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x35:0x0]) in obj [0x200000bd1:0x35:0x0], intent: readdir flags 0 00010000:00010000:3.0:1782487606.859541:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.859549:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1782487606.860183:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebecb100 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455040:192.168.202.121@tcp:37:rm.0 00000100:00100000:3.0:1782487606.860261:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6aee2e8000 going to sleep for 11 seconds 00000100:00100000:0.0:1782487606.870440:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebecb100 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455040:192.168.202.121@tcp:37:rm.0 00010000:00010000:0.0:1782487606.871079:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.871094:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:0.0:1782487606.871192:0:295211:0:(file.c:447:ll_file_release()) START file d77r.sanityn:[0x200000bd1:0x35:0x0](ffff8a6af0494b08), flags 704000 00000002:00100000:0.0:1782487606.871256:0:295211:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8a6aebecb480 x1869066294454912/t8589957021(8589957021) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1782487606.871267:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1782487606.871272:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf731500 x1869066294455296/t0(0) o35->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1782487606.871292:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf731500 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455296:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1782487606.871354:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487606.873253:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf731500 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455296:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1782487606.873275:0:295211:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8a6aebecb480 x1869066294454912/t8589957021(8589957021) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1782487606.873360:0:295211:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:0.0:1782487606.873373:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782487606.873387:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.873399:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1782487606.873407:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782487606.873412:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:0.0:1782487606.873415:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a442323 00000080:00010000:0.0:1782487606.873422:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a442323 from it ffff99a4c15a3bf8 00010000:00010000:0.0:1782487606.873426:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.873433:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1782487606.873445:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148), inode mode 41ff mask 1 00000080:00200000:0.0:1782487606.873451:0:295211:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=266 00000080:00200000:0.0:1782487606.873459:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 44 00000080:00200008:0.0:1782487606.873466:0:295211:0:(file.c:1058:ll_file_open()) START file d77r.sanityn:[0x200000bd1:0x35:0x0](ffff8a6af0494b08), flags 704400 00000002:00010000:0.0:1782487606.873479:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x35:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1782487606.873515:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.873522:0:295211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1782487606.873537:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1782487606.873549:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf731500 x1869066294455552/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1782487606.873558:0:295211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.873573:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf731500 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455552:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1782487606.873706:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79240 going to sleep for 176 seconds 00000100:00100000:0.0:1782487606.878608:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf731500 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455552:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1782487606.878639:0:295211:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.878651:0:295211:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.878663:0:295211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.878675:0:295211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782487606.878688:0:295211:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff8a6adf731500 x1869066294455552/t8589957023(8589957023) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1782487606.878701:0:295211:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8a6adf731500 x1869066294455552/t8589957023(8589957023) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782487606.878761:0:295211:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.878772:0:295211:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8a6aca90a400 type 13 mode 16 res 8589937617/53 (0 0) 00000080:00200000:0.0:1782487606.878778:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1782487606.878798:0:295211:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x200000bd1:0x35:0x0], updating i_size 7680 00000080:00010000:0.0:1782487606.878803:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x35:0x0](ffff8a6af0494b08) for lock 0x43f633357a478539 00000080:00010000:0.0:1782487606.878810:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478539 from it ffff99a4c15a3bd0 00010000:00010000:0.0:1782487606.878814:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.878823:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1782487606.878846:0:295211:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8a6adf731500 x1869066294455552/t8589957023(8589957023) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1782487606.878908:0:295211:0:(file.c:6217:ll_getattr_dentry()) START file d77r.sanityn:[0x200000bd1:0x35:0x0](ffff8a6af0494b08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1782487606.878916:0:295211:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08),name=d77r.sanityn 00000002:00010000:0.0:1782487606.878936:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x35:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782487606.878947:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782487606.878957:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1782487606.878964:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782487606.878975:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x35:0x0](ffff8a6af0494b08) 00000080:00010000:0.0:1782487606.878978:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x35:0x0](ffff8a6af0494b08) for lock 0x43f633357a47852b 00000080:00010000:0.0:1782487606.878983:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a47852b from it ffff99a4c15a3cd8 00010000:00010000:0.0:1782487606.878986:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782487606.878994:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1782487606.879071:0:295211:0:(llite_lib.c:2774:ll_statfs()) VFS Op:sb=lustre (ffff8a6ad0efd000) d77r.sanityn proj=0 00000080:00000004:0.0:1782487606.879076:0:295211:0:(obd_class.h:1091:obd_statfs()) lustre-clilmv-ffff8a6ad0efd000: age 7024, max_age 7233 00800000:00000004:0.0:1782487606.879082:0:295211:0:(obd_class.h:1091:obd_statfs()) lustre-MDT0000-mdc-ffff8a6ad0efd000: age 7024, max_age 7233 00000100:00100000:0.0:1782487606.879117:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf732d80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455680:192.168.202.121@tcp:41:rm.0 00000100:00100000:0.0:1782487606.879188:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79840 going to sleep for 176 seconds 00000100:00100000:0.0:1782487606.881324:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf732d80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455680:192.168.202.121@tcp:41:rm.0 00800000:00000004:0.0:1782487606.881353:0:295211:0:(obd_class.h:1117:obd_statfs()) lustre-MDT0000-mdc-ffff8a6ad0efd000: update ffff8a6ac33e1e10 cache blocks 1870592/1885184 objects 233952/248389 00000080:00000004:0.0:1782487606.881358:0:295211:0:(obd_class.h:1117:obd_statfs()) lustre-clilmv-ffff8a6ad0efd000: update ffff8a6ac33e5190 cache blocks 1870592/1885184 objects 233952/248389 00000080:00000004:0.0:1782487606.881362:0:295211:0:(llite_lib.c:2626:ll_statfs_internal()) MDC blocks 1870592/1885184 objects 233952/248389 00000080:00200000:0.0:1782487606.881383:0:295211:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08) pos/size0/7680 32bit_api 0 00000080:00200000:0.0:1782487606.881409:0:295211:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200000:0.0:1782487606.881429:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 1 00000080:00200000:0.0:1782487606.881442:0:295211:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-18, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), flags=0 00000080:00200000:0.0:1782487606.881447:0:295211:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-18, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), intent=getattr 00000002:00010000:0.0:1782487606.881468:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-18,[0x0:0x0:0x0]) in obj [0x200000bd1:0x35:0x0], intent: getattr flags 01 00010000:00010000:0.0:1782487606.881505:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.881540:0:295211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.881550:0:295211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.881566:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf732d80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455808:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1782487606.881614:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79240 going to sleep for 176 seconds 00000100:00100000:0.0:1782487606.884753:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf732d80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294455808:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1782487606.884775:0:295211:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.884855:0:295211:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.884865:0:295211:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.884875:0:295211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.884885:0:295211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.884896:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.884919:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.884926:0:295211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782487606.884938:0:295211:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8a6adf732d80 x1869066294455808/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 584/640 e 0 to 0 dl 1782487787 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782487606.884948:0:295211:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1782487606.884960:0:295211:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.884969:0:295211:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8a6aca90a400 type 13 mode 4 res 8589937618/2839 (0 0) 00000080:00200000:0.0:1782487606.884974:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x35:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1782487606.884999:0:295211:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0xb17:0x0](ffff8a6ac2140908) 00000080:00200000:0.0:1782487606.885202:0:295211:0:(file.c:6749:ll_layout_conf()) [0x200000bd2:0xb17:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1782487606.885212:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0xb17:0x0](ffff8a6ac2140908) for lock 0x43f633357a478540 00000080:00010000:0.0:1782487606.885220:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0xb17:0x0](ffff8a6ac2140908) 00000080:00010000:0.0:1782487606.885223:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478540 from it ffff99a4c15a3df8 00010000:00010000:0.0:1782487606.885227:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.885250:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782487606.885290:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 3 00000080:00200000:0.0:1782487606.885298:0:295211:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-18, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08) 00010000:00010000:0.0:1782487606.885336:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1782487606.885353:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6b01dac000/0x43f633357a442331 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b85d expref: -99 pid: 274468 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.885409:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782487606.885439:0:295211:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0xb17:0x0]: losing layout lock 00010000:00010000:0.0:1782487606.885472:0:295211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.885480:0:295211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1782487606.885486:0:295211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1782487606.885489:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478540 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x66475b4e8b85eee7 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.885503:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df600/0x43f633357a47852b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b85eea8 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000020:00100000:0.0:1782487606.885645:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1782487606.885652:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf732d80 x1869066294456064/t0(0) o36->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782487606.885876:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf732d80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294456064:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1782487606.885939:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79840 going to sleep for 176 seconds 00000100:00100000:3.0:1782487606.888618:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1782487606.888641:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1782487606.888654:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1782487606.888673:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1782487606.888700:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1782487606.888716:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299320576 00000100:00100000:3.0:1782487606.888743:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299320576 00000100:00100000:3.0:1782487606.888769:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299320704 00000100:00100000:3.0:1782487606.888770:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299320704 00000100:00100000:3.0:1782487606.888775:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299320832 00000100:00100000:3.0:1782487606.888776:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299320832 00000100:00100000:3.0:1782487606.888781:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299320960 00000100:00100000:3.0:1782487606.888782:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299320960 00000100:00100000:3.0:1782487606.888786:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299321088 00000100:00100000:3.0:1782487606.888787:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299321088 00000100:00100000:3.0:1782487606.888795:0:266186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5543 00000100:00100000:3.0:1782487606.888800:0:266186:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aebecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+9:190298:x1869066299320576:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1782487606.888811:0:266186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de000/0x43f633357a4784e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e3e9 expref: -99 pid: 294638 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.888854:0:266186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782487606.888859:0:266186:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aebecb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+9:190298:x1869066299320576:12345-192.168.202.121@tcp:104: Request processed in 59us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.888864:0:266186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5543 00000100:00100000:3.0:1782487606.888875:0:266186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5544 00000100:00100000:3.0:1782487606.888878:0:266186:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aebec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:190298:x1869066299320704:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1782487606.888883:0:266186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9e00/0x43f633357a478413 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e1b9 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.888906:0:266186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782487606.888910:0:266186:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aebec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:190298:x1869066299320704:12345-192.168.202.121@tcp:104: Request processed in 32us (269us total) trans 0 rc 0/0 00010000:00010000:1.0:1782487606.888913:0:265367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487606.888921:0:265367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de000/0x43f633357a4784e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e3e9 expref: -99 pid: 294638 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.888931:0:261832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487606.888934:0:265367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af81de000 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487606.888939:0:261832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9e00/0x43f633357a478413 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e1b9 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.888942:0:265367:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de000/0x43f633357a4784e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e3e9 expref: -99 pid: 294638 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.888960:0:261832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aee3d9e00 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:1.0:1782487606.888964:0:265367:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de000/0x43f633357a4784e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e3e9 expref: -99 pid: 294638 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.888967:0:261832:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9e00/0x43f633357a478413 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e1b9 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.888980:0:265367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de000/0x43f633357a4784e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e3e9 expref: -99 pid: 294638 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.888982:0:261832:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9e00/0x43f633357a478413 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e1b9 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889001:0:261832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9e00/0x43f633357a478413 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e1b9 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.889011:0:265367:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782487606.889037:0:261832:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1782487606.889056:0:265367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de000/0x43f633357a4784e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e3e9 expref: -99 pid: 294638 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.889062:0:265367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.889072:0:261832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9e00/0x43f633357a478413 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e1b9 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.889079:0:265367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de000/0x43f633357a4784e5 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e3e9 expref: -99 pid: 294638 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889080:0:261832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.889091:0:261832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9e00/0x43f633357a478413 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e1b9 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.889103:0:265367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de000/0x43f633357a4784e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e3e9 expref: -99 pid: 294638 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889106:0:261832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9e00/0x43f633357a478413 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e1b9 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.889117:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.889121:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.889123:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.889130:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.889134:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.889136:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487606.889137:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6af8188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294456192:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.889167:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294456320:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487606.889266:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5545 00000100:00100000:2.0:1782487606.889276:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aebec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:190298:x1869066299320832:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487606.889284:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5266a00/0x43f633357a478444 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e0e0 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487606.889321:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487606.889327:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aebec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:190298:x1869066299320832:12345-192.168.202.121@tcp:104: Request processed in 54us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487606.889334:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5545 00010000:00010000:0.0:1782487606.889344:0:261170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487606.889350:0:261170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5266a00/0x43f633357a478444 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e0e0 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1782487606.889353:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5546 00010000:00010000:0.0:1782487606.889363:0:261170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af5266a00 already unused, calling callback (ffffffffc1b9bfa0) 00000100:00100000:2.0:1782487606.889366:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aebecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:190298:x1869066299320960:12345-192.168.202.121@tcp:104: 00010000:00010000:0.0:1782487606.889369:0:261170:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5266a00/0x43f633357a478444 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e0e0 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487606.889381:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac0030800/0x43f633357a478348 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e08c expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889381:0:261170:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5266a00/0x43f633357a478444 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e0e0 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889403:0:261170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5266a00/0x43f633357a478444 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e0e0 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889426:0:261170:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1782487606.889431:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487606.889440:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aebecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:190298:x1869066299320960:12345-192.168.202.121@tcp:104: Request processed in 75us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487606.889447:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5546 00010000:00010000:0.0:1782487606.889450:0:261170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5266a00/0x43f633357a478444 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e0e0 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889457:0:261170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782487606.889462:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5547 00010000:00010000:0.0:1782487606.889473:0:261170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5266a00/0x43f633357a478444 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e0e0 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889487:0:261170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5266a00/0x43f633357a478444 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e0e0 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889498:0:261170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487606.889502:0:261170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac0030800/0x43f633357a478348 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e08c expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889508:0:261170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac0030800 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487606.889511:0:261170:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac0030800/0x43f633357a478348 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e08c expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889517:0:261170:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac0030800/0x43f633357a478348 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e08c expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889524:0:261170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac0030800/0x43f633357a478348 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e08c expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889536:0:261170:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1782487606.889554:0:261170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac0030800/0x43f633357a478348 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e08c expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889560:0:261170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.889566:0:261170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac0030800/0x43f633357a478348 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e08c expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889583:0:261170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac0030800/0x43f633357a478348 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e08c expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.889593:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.889595:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.889596:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487606.889607:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294456576:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.889635:0:2361:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487606.889640:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294456448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487606.889656:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aebec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:190298:x1869066299321088:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487606.889663:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1782487606.889703:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487606.889707:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aebec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:190298:x1869066299321088:12345-192.168.202.121@tcp:104: Request processed in 57us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487606.889711:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5547 00010000:00010000:1.0:1782487606.889763:0:265368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487606.889769:0:265368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1782487606.889779:0:265368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aedc8c800 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:1.0:1782487606.889783:0:265368:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1782487606.889792:0:265368:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1782487606.889800:0:265368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:1.0:1782487606.889836:0:265368:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0xb17:0x0]: losing layout lock 00010000:00010000:1.0:1782487606.889879:0:265368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000100:00100000:3.0:1782487606.889882:0:266186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5544 00010000:00010000:1.0:1782487606.889890:0:265368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782487606.889908:0:265368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1782487606.889916:0:265368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8c800/0x43f633357a4783d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb17:0x0].0x0 bits 0x19/0x19 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e03f expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1782487606.889930:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.889931:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.889933:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487606.889943:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6af818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294456704:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487606.890192:0:261169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487606.891923:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294456448:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.891937:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294456576:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.891945:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294456320:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.892297:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6af818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294456704:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.892307:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6af8188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294456192:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.897699:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf732d80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294456064:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1782487606.897933:0:295211:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd2:0xb17:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1782487606.897945:0:295211:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1782487606.897993:0:295211:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd2:0xb17:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1782487606.898020:0:295211:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0xb17:0x0](ffff8a6ac2140908) 00000080:00200000:0.0:1782487606.898213:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 1 00000080:00200000:0.0:1782487606.898230:0:295211:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-20, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), flags=0 00000080:00200000:0.0:1782487606.898247:0:295211:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-20, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), intent=getattr 00000002:00010000:0.0:1782487606.898279:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-20,[0x0:0x0:0x0]) in obj [0x200000bd1:0x35:0x0], intent: getattr flags 01 00010000:00010000:0.0:1782487606.898339:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.898350:0:295211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.898359:0:295211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.898379:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730380 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294456832:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1782487606.898447:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79240 going to sleep for 176 seconds 00000100:00100000:0.0:1782487606.900152:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730380 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294456832:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1782487606.900167:0:295211:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900183:0:295211:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900191:0:295211:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900202:0:295211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900212:0:295211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900224:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900260:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900268:0:295211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782487606.900280:0:295211:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8a6adf730380 x1869066294456832/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 584/640 e 0 to 0 dl 1782487787 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782487606.900290:0:295211:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1782487606.900302:0:295211:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900312:0:295211:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8a6aca90a400 type 13 mode 4 res 8589937618/2840 (0 0) 00000080:00200000:0.0:1782487606.900317:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x35:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1782487606.900345:0:295211:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0xb18:0x0](ffff8a6ac21421c8) 00000080:00200000:0.0:1782487606.900443:0:295211:0:(file.c:6749:ll_layout_conf()) [0x200000bd2:0xb18:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1782487606.900455:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0xb18:0x0](ffff8a6ac21421c8) for lock 0x43f633357a478547 00000080:00010000:0.0:1782487606.900464:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0xb18:0x0](ffff8a6ac21421c8) 00000080:00010000:0.0:1782487606.900467:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478547 from it ffff99a4c15a3df8 00010000:00010000:0.0:1782487606.900471:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.900480:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782487606.900517:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 3 00000080:00200000:0.0:1782487606.900524:0:295211:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-20, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08) 00010000:00010000:0.0:1782487606.900561:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782487606.900583:0:295211:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0xb18:0x0]: losing layout lock 00010000:00010000:0.0:1782487606.900629:0:295211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.900637:0:295211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.900640:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267600/0x43f633357a478547 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x66475b4e8b85ef1f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1782487606.900666:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1782487606.900673:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf730380 x1869066294457088/t0(0) o36->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782487606.900691:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730380 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294457088:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1782487606.900759:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79840 going to sleep for 176 seconds 00000100:00100000:3.0:1782487606.903112:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487606.903156:0:261161:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299321216 00000100:00100000:2.0:1782487606.903163:0:261161:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299321216 00000100:00100000:2.0:1782487606.903209:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5548 00000100:00100000:2.0:1782487606.903218:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aebec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:190296:x1869066299321216:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487606.903245:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aefa9c200/0x43f633357a4784d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e310 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487606.903307:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487606.903314:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aebec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:190296:x1869066299321216:12345-192.168.202.121@tcp:104: Request processed in 97us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487606.903321:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5548 00010000:00010000:1.0:1782487606.903834:0:265367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487606.903842:0:265367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aefa9c200/0x43f633357a4784d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e310 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.903851:0:265367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aefa9c200 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:1.0:1782487606.903856:0:265367:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aefa9c200/0x43f633357a4784d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e310 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.903864:0:265367:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aefa9c200/0x43f633357a4784d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e310 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.903873:0:265367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aefa9c200/0x43f633357a4784d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e310 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.903894:0:265367:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac2c60c00/0x43f633357a4784bb lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e284 expref: -99 pid: 294621 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1782487606.903940:0:265367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aefa9c200/0x43f633357a4784d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e310 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.903947:0:265367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782487606.903974:0:265367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aefa9c200/0x43f633357a4784d0 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e310 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.903982:0:265367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aefa9c200/0x43f633357a4784d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb18:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e310 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.903994:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.903995:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.903997:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487606.904007:0:2360:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487606.904021:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6af8188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294457216:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.906491:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730380 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294457088:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1782487606.906565:0:295211:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd2:0xb18:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1782487606.906575:0:295211:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1782487606.906609:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6af8188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294457216:192.168.202.121@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1782487606.906620:0:295211:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd2:0xb18:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1782487606.906638:0:295211:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0xb18:0x0](ffff8a6ac21421c8) 00000080:00200000:0.0:1782487606.906714:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 1 00000080:00200000:0.0:1782487606.906754:0:295211:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-19, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), flags=0 00000080:00200000:0.0:1782487606.906768:0:295211:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-19, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), intent=getattr 00000002:00010000:0.0:1782487606.906804:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-19,[0x0:0x0:0x0]) in obj [0x200000bd1:0x35:0x0], intent: getattr flags 01 00010000:00010000:0.0:1782487606.906848:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.906856:0:295211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.906865:0:295211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.906881:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf732300 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294457344:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1782487606.906954:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79240 going to sleep for 176 seconds 00000100:00100000:0.0:1782487606.909890:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf732300 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294457344:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1782487606.909912:0:295211:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.909943:0:295211:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.909951:0:295211:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.909962:0:295211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.909980:0:295211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.910014:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.910023:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.910030:0:295211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782487606.910042:0:295211:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8a6adf732300 x1869066294457344/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 584/640 e 0 to 0 dl 1782487787 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782487606.910053:0:295211:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1782487606.910065:0:295211:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.910073:0:295211:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8a6aca90a400 type 13 mode 4 res 8589937618/2838 (0 0) 00000080:00200000:0.0:1782487606.910088:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x35:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1782487606.910116:0:295211:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0xb16:0x0](ffff8a6ac2140908) 00000080:00200000:0.0:1782487606.910216:0:295211:0:(file.c:6749:ll_layout_conf()) [0x200000bd2:0xb16:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1782487606.910226:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0xb16:0x0](ffff8a6ac2140908) for lock 0x43f633357a47854e 00000080:00010000:0.0:1782487606.910246:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0xb16:0x0](ffff8a6ac2140908) 00000080:00010000:0.0:1782487606.910250:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a47854e from it ffff99a4c15a3df8 00010000:00010000:0.0:1782487606.910253:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.910270:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782487606.910297:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 3 00000080:00200000:0.0:1782487606.910303:0:295211:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-19, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08) 00010000:00010000:0.0:1782487606.910341:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782487606.910360:0:295211:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0xb16:0x0]: losing layout lock 00010000:00010000:0.0:1782487606.910392:0:295211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.910399:0:295211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.910402:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a47854e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x66475b4e8b85ef57 expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1782487606.910423:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1782487606.910429:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf732300 x1869066294457600/t0(0) o36->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782487606.910447:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf732300 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294457600:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1782487606.910512:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79840 going to sleep for 176 seconds 00000100:00100000:2.0:1782487606.913838:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487606.913870:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:0.0:1782487606.913920:0:281907:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782487606.913934:0:261162:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782487606.913949:0:261162:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299321344 00000100:00100000:3.0:1782487606.913958:0:261162:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299321344 00000100:00100000:0.0:1782487606.913962:0:281907:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299321472 00000100:00100000:0.0:1782487606.913975:0:281907:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299321472 00000100:00100000:3.0:1782487606.914003:0:261162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5549 00000100:00100000:3.0:1782487606.914011:0:261162:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ad25dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:213218:x1869066299321344:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1782487606.914025:0:261162:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de800/0x43f633357a4784d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e38e expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1782487606.914072:0:2354:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00010000:00010000:3.0:1782487606.914118:0:261162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782487606.914125:0:261162:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ad25dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:213218:x1869066299321344:12345-192.168.202.121@tcp:104: Request processed in 114us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.914132:0:261162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5549 00010000:00010000:3.0:1782487606.914175:0:261832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487606.914180:0:261832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de800/0x43f633357a4784d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e38e expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914186:0:261832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af81de800 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:3.0:1782487606.914189:0:261832:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de800/0x43f633357a4784d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e38e expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914196:0:261832:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de800/0x43f633357a4784d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e38e expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914201:0:261832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de800/0x43f633357a4784d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e38e expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914230:0:261832:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.914275:0:261832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de800/0x43f633357a4784d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e38e expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914282:0:261832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782487606.914307:0:261832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de800/0x43f633357a4784d7 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e38e expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914315:0:261832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af81de800/0x43f633357a4784d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e38e expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914332:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.914334:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.914335:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487606.914351:0:2363:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782487606.914364:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294457728:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.914554:0:261159:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299321600 00000100:00100000:1.0:1782487606.914562:0:261159:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299321600 00000100:00100000:0.0:1782487606.914565:0:281907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 1213 00000100:00100000:0.0:1782487606.914578:0:281907:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6b01ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:213218:x1869066299321472:12345-192.168.202.121@tcp:104: 00000100:00100000:2.0:1782487606.914579:0:2354:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00010000:00010000:0.0:1782487606.914595:0:281907:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac524d000/0x43f633357a47841a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e1d5 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.914635:0:281907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782487606.914637:0:261161:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299321728 00000100:00100000:0.0:1782487606.914643:0:281907:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6b01ec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:213218:x1869066299321472:12345-192.168.202.121@tcp:104: Request processed in 68us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.914644:0:261161:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299321728 00000100:00100000:0.0:1782487606.914654:0:281907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 1213 00000100:00100000:1.0:1782487606.914667:0:261159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 1214 00000100:00100000:3.0:1782487606.914678:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5550 00000100:00100000:1.0:1782487606.914683:0:261159:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace298e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:213218:x1869066299321600:12345-192.168.202.121@tcp:104: 00010000:00010000:1.0:1782487606.914695:0:261159:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6b01cf0200/0x43f633357a47844b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e150 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.914708:0:261170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487606.914714:0:261170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac524d000/0x43f633357a47841a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e1d5 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.914743:0:261170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac524d000 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487606.914747:0:261170:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac524d000/0x43f633357a47841a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e1d5 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.914754:0:261159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1782487606.914755:0:261170:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac524d000/0x43f633357a47841a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e1d5 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1782487606.914766:0:261159:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace298e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:213218:x1869066299321600:12345-192.168.202.121@tcp:104: Request processed in 88us (690us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487606.914768:0:261170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac524d000/0x43f633357a47841a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e1d5 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.914787:0:261170:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 7 lru_type: 1 00000100:00100000:1.0:1782487606.914789:0:261159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 1214 00010000:00010000:1.0:1782487606.914810:0:265368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487606.914816:0:265368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6b01cf0200/0x43f633357a47844b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e150 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.914825:0:265368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6b01cf0200 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:1.0:1782487606.914829:0:265368:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6b01cf0200/0x43f633357a47844b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e150 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.914840:0:265368:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6b01cf0200/0x43f633357a47844b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e150 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1782487606.914843:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213218:x1869066299321728:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1782487606.914857:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac86c9200/0x43f633357a47834f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e0d9 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.914857:0:265368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6b01cf0200/0x43f633357a47844b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 8 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e150 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.914884:0:265368:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1782487606.914898:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1782487606.914909:0:265368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6b01cf0200/0x43f633357a47844b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e150 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1782487606.914913:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213218:x1869066299321728:12345-192.168.202.121@tcp:104: Request processed in 72us (336us total) trans 0 rc 0/0 00010000:00010000:0.0:1782487606.914920:0:261170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac524d000/0x43f633357a47841a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e1d5 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.914926:0:265368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782487606.914929:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5550 00010000:00010000:0.0:1782487606.914942:0:261170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782487606.914947:0:261169:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487606.914949:0:265368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6b01cf0200/0x43f633357a47844b lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e150 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914954:0:261169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac86c9200/0x43f633357a47834f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e0d9 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.914960:0:261170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac524d000/0x43f633357a47841a lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 8 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e1d5 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.914970:0:265368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6b01cf0200/0x43f633357a47844b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 8 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e150 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914971:0:261169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac86c9200 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:3.0:1782487606.914977:0:261169:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac86c9200/0x43f633357a47834f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 8 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e0d9 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.914992:0:261170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac524d000/0x43f633357a47841a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 8 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e1d5 expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.914994:0:261169:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac86c9200/0x43f633357a47834f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 8 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e0d9 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.915017:0:261169:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac86c9200/0x43f633357a47834f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 8 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e0d9 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.915023:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.915031:0:261169:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782487606.915048:0:261169:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac86c9200/0x43f633357a47834f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e0d9 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.915054:0:261169:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782487606.915065:0:261169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac86c9200/0x43f633357a47834f lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e0d9 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.915071:0:261169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac86c9200/0x43f633357a47834f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e0d9 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.915073:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.915077:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487606.915090:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294457984:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487606.915094:0:261169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.915097:0:261169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.915099:0:261169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487606.915115:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294458112:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.915128:0:2361:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487606.915138:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6af8188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294457856:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487606.915174:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.915176:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.915179:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487606.918618:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487606.918677:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294457728:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487606.918703:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299321856 00000100:00100000:2.0:1782487606.918707:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299321856 00000100:00100000:2.0:1782487606.918814:0:266186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5551 00000100:00100000:2.0:1782487606.918823:0:266186:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace29a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213218:x1869066299321856:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487606.918847:0:266186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1782487606.918900:0:266186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487606.918906:0:266186:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace29a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213218:x1869066299321856:12345-192.168.202.121@tcp:104: Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487606.918914:0:266186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5551 00010000:00010000:1.0:1782487606.918931:0:265367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782487606.918939:0:265367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782487606.918949:0:265367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aedc8d200 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:1.0:1782487606.918954:0:265367:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782487606.918964:0:265367:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782487606.918973:0:265367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782487606.918996:0:265367:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af29cf200/0x43f633357a478325 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ddad expref: -99 pid: 294616 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.919040:0:265367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782487606.919059:0:265367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782487606.919090:0:265367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782487606.919099:0:265367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aedc8d200/0x43f633357a4783e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb16:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e093 expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782487606.919115:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.919117:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.919120:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487606.919131:0:2361:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487606.919142:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6af818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294458240:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.921117:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6af8188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294457856:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487606.921122:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294458112:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.921137:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294457984:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.923409:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6af818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294458240:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.929377:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf732300 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294457600:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1782487606.929454:0:295211:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd2:0xb16:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1782487606.929464:0:295211:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1782487606.929509:0:295211:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd2:0xb16:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1782487606.929521:0:295211:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0xb16:0x0](ffff8a6ac2140908) 00000080:00200000:0.0:1782487606.929597:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 1 00000080:00200000:0.0:1782487606.929612:0:295211:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-17, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), flags=0 00000080:00200000:0.0:1782487606.929617:0:295211:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-17, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), intent=getattr 00000002:00010000:0.0:1782487606.929642:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-17,[0x0:0x0:0x0]) in obj [0x200000bd1:0x35:0x0], intent: getattr flags 01 00010000:00010000:0.0:1782487606.929702:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.929713:0:295211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.929767:0:295211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 295211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487606.929785:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf733100 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294458368:192.168.202.121@tcp:101:rm.0 00000100:00100000:0.0:1782487606.930119:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79240 going to sleep for 176 seconds 00000100:00100000:0.0:1782487606.933617:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf733100 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294458368:192.168.202.121@tcp:101:rm.0 00010000:00010000:0.0:1782487606.933640:0:295211:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.933668:0:295211:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.933677:0:295211:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.933688:0:295211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.933699:0:295211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.933710:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.933798:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.933808:0:295211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782487606.933819:0:295211:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8a6adf733100 x1869066294458368/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 584/640 e 0 to 0 dl 1782487787 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782487606.933830:0:295211:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1782487606.933854:0:295211:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.933864:0:295211:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8a6aca90a400 type 13 mode 4 res 8589937618/2837 (0 0) 00000080:00200000:0.0:1782487606.933871:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x35:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1782487606.933899:0:295211:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0xb15:0x0](ffff8a6ac21421c8) 00000080:00200000:0.0:1782487606.934006:0:295211:0:(file.c:6749:ll_layout_conf()) [0x200000bd2:0xb15:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1782487606.934017:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0xb15:0x0](ffff8a6ac21421c8) for lock 0x43f633357a478555 00000080:00010000:0.0:1782487606.934027:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0xb15:0x0](ffff8a6ac21421c8) 00000080:00010000:0.0:1782487606.934031:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478555 from it ffff99a4c15a3df8 00010000:00010000:0.0:1782487606.934034:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487606.934043:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782487606.934072:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x35:0x0](ffff8a6af0494b08), inode mode 41ff mask 3 00000080:00200000:0.0:1782487606.934079:0:295211:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-17, dir=[0x200000bd1:0x35:0x0](ffff8a6af0494b08) 00010000:00010000:0.0:1782487606.934115:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782487606.934136:0:295211:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0xb15:0x0]: losing layout lock 00010000:00010000:0.0:1782487606.934172:0:295211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.934180:0:295211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.934189:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5266a00/0x43f633357a478555 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x66475b4e8b85ef8f expref: -99 pid: 295211 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1782487606.934211:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1782487606.934217:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf733100 x1869066294458624/t0(0) o36->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782487606.934252:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf733100 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294458624:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1782487606.934314:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79840 going to sleep for 176 seconds 00000100:00100000:2.0:1782487606.936322:0:2354:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1782487606.936954:0:261162:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299321984 00000100:00100000:3.0:1782487606.936962:0:261162:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299321984 00000100:00100000:3.0:1782487606.937004:0:261162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5552 00000100:00100000:3.0:1782487606.937014:0:261162:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace29b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213684:x1869066299321984:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1782487606.937028:0:261162:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9400/0x43f633357a47840c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e19d expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.937088:0:261162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782487606.937096:0:261162:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace29b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213684:x1869066299321984:12345-192.168.202.121@tcp:104: Request processed in 82us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.937104:0:261162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5552 00010000:00010000:0.0:1782487606.937265:0:261832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487606.937272:0:261832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9400/0x43f633357a47840c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e19d expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.937282:0:261832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aee3d9400 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487606.937287:0:261832:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9400/0x43f633357a47840c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e19d expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.937296:0:261832:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9400/0x43f633357a47840c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e19d expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.937305:0:261832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9400/0x43f633357a47840c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e19d expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.937328:0:261832:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1782487606.937358:0:261832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9400/0x43f633357a47840c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e19d expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.937380:0:261832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.937411:0:261832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9400/0x43f633357a47840c lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e19d expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.937419:0:261832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d9400/0x43f633357a47840c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e19d expref: -99 pid: 294627 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.937432:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.937434:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.937435:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487606.937446:0:2360:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782487606.937457:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294458752:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782487606.937574:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487606.937628:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1782487606.937670:0:261162:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299322112 00000100:00100000:3.0:1782487606.937675:0:261162:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299322112 00000100:00100000:2.0:1782487606.937699:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487606.937752:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487606.937773:0:266186:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782487606.937783:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299322240 00000100:00100000:2.0:1782487606.937786:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299322240 00000100:00100000:3.0:1782487606.937973:0:261162:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299322368 00000100:00100000:3.0:1782487606.937977:0:261162:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299322368 00000100:00100000:2.0:1782487606.939407:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299322496 00000100:00100000:2.0:1782487606.939413:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299322496 00000100:00100000:2.0:1782487606.939436:0:266186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5553 00000100:00100000:2.0:1782487606.939443:0:266186:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:213684:x1869066299322112:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487606.939453:0:266186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac13a0000/0x43f633357a47843d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e085 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487606.939548:0:266186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487606.939555:0:266186:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+8:213684:x1869066299322112:12345-192.168.202.121@tcp:104: Request processed in 112us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487606.939561:0:266186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5553 00000100:00100000:2.0:1782487606.939575:0:266186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5554 00000100:00100000:2.0:1782487606.939590:0:266186:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace299180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:213684:x1869066299322240:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487606.939599:0:266186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac6b70e00/0x43f633357a478341 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e031 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.939645:0:265368:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782487606.939662:0:265368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac13a0000/0x43f633357a47843d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e085 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.939669:0:265368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac13a0000 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:1.0:1782487606.939673:0:265368:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac13a0000/0x43f633357a47843d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e085 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.939680:0:265368:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac13a0000/0x43f633357a47843d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e085 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.939694:0:265368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac13a0000/0x43f633357a47843d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e085 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.939712:0:265368:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00000100:00100000:3.0:1782487606.940452:0:261162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5555 00000100:00100000:3.0:1782487606.940465:0:261162:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ad25dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:213684:x1869066299322496:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1782487606.940475:0:261162:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d8200/0x43f633357a4783cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85de08 expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.940980:0:261162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782487606.940989:0:261162:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ad25dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+7:213684:x1869066299322496:12345-192.168.202.121@tcp:104: Request processed in 527us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.940999:0:261162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5555 00000100:00100000:3.0:1782487606.941023:0:261162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5556 00000100:00100000:3.0:1782487606.941031:0:261162:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:213684:x1869066299322368:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1782487606.941040:0:261162:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941075:0:261162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782487606.941082:0:261162:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+6:213684:x1869066299322368:12345-192.168.202.121@tcp:104: Request processed in 52us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.941090:0:261162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5556 00010000:00010000:3.0:1782487606.941112:0:261170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782487606.941118:0:261170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac6b70e00/0x43f633357a478341 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85e031 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941127:0:261170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac6b70e00 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:3.0:1782487606.941132:0:261170:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac6b70e00/0x43f633357a478341 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e031 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941141:0:261170:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac6b70e00/0x43f633357a478341 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85e031 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941150:0:261170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac6b70e00/0x43f633357a478341 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85e031 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941173:0:261170:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941204:0:261170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac6b70e00/0x43f633357a478341 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e031 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941211:0:261170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782487606.941244:0:261170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac6b70e00/0x43f633357a478341 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e031 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941252:0:261170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac6b70e00/0x43f633357a478341 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e031 expref: -99 pid: 294630 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941269:0:261170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782487606.941273:0:261170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d8200/0x43f633357a4783cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85de08 expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941281:0:261170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aee3d8200 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:3.0:1782487606.941285:0:261170:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d8200/0x43f633357a4783cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85de08 expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941292:0:261170:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d8200/0x43f633357a4783cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85de08 expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941300:0:261170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d8200/0x43f633357a4783cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85de08 expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941323:0:261170:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941404:0:261170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d8200/0x43f633357a4783cd lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85de08 expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941412:0:261170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782487606.941421:0:261170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d8200/0x43f633357a4783cd lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85de08 expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941429:0:261170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee3d8200/0x43f633357a4783cd lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85de08 expref: -99 pid: 294626 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782487606.941443:0:261170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782487606.941447:0:261170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941454:0:261170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aeeae9200 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:3.0:1782487606.941458:0:261170:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941466:0:261170:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941474:0:261170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941501:0:261170:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ae0362200/0x43f633357a478317 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85dd13 expref: -99 pid: 294613 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782487606.941597:0:261170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 3/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941605:0:261170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782487606.941612:0:261170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1782487606.941621:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.941623:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.941627:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487606.941636:0:261169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487606.941651:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294459008:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487606.941739:0:2363:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782487606.941748:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294458880:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487606.941785:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294459136:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782487606.943294:0:265368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aeeae9200/0x43f633357a4783c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85dfeb expref: -99 pid: 294628 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1782487606.943316:0:265368:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ae0362200/0x43f633357a478317 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x66475b4e8b85dd13 expref: -99 pid: 294613 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1782487606.943345:0:265368:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac13a0000/0x43f633357a47843d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e085 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.943352:0:265368:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782487606.943365:0:265368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac13a0000/0x43f633357a47843d lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e085 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.943372:0:265368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6ac13a0000/0x43f633357a47843d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xb15:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x66475b4e8b85e085 expref: -99 pid: 294629 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1782487606.943385:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.943387:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782487606.943389:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487606.943402:0:2361:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782487606.943415:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6af818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294459264:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.944274:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294458752:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782487606.944363:0:266186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:1.0:1782487606.944364:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782487606.944373:0:266186:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace299180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213684:x1869066299322240:12345-192.168.202.121@tcp:104: Request processed in 4781us (6742us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487606.944383:0:266186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5554 00000100:00100000:3.0:1782487606.946066:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294458880:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487606.946082:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294459136:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487606.946092:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2363:1869066294459008:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.946350:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6af818a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294459264:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.947991:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf733100 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294458624:192.168.202.121@tcp:36:rm.0 00000080:00200000:0.0:1782487606.948054:0:295211:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd2:0xb15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1782487606.948404:0:295211:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1782487606.948462:0:295211:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd2:0xb15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1782487606.948476:0:295211:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0xb15:0x0](ffff8a6ac21421c8) 00000080:00200008:0.0:1782487606.948562:0:295211:0:(file.c:447:ll_file_release()) START file d77r.sanityn:[0x200000bd1:0x35:0x0](ffff8a6af0494b08), flags 704000 00010000:00010000:0.0:1782487606.948585:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782487606.948622:0:295211:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:0.0:1782487606.948636:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782487606.948647:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.948675:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1782487606.948683:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782487606.948689:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:0.0:1782487606.948693:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a442323 00000080:00010000:0.0:1782487606.948700:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a442323 from it ffff99a4c15a3c10 00010000:00010000:0.0:1782487606.948704:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.948713:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1782487606.948780:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148), inode mode 41ff mask 1 00000080:00200000:0.0:1782487606.948790:0:295211:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=0 00000080:00200000:0.0:1782487606.948796:0:295211:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:0.0:1782487606.948804:0:295211:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782487606.948811:0:295211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.948820:0:295211:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1782487606.948826:0:295211:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782487606.948831:0:295211:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:0.0:1782487606.948840:0:295211:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a442323 00000080:00010000:0.0:1782487606.948844:0:295211:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a442323 from it ffff99a4c15a3d88 00010000:00010000:0.0:1782487606.948854:0:295211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.948862:0:295211:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1782487606.948872:0:295211:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148), inode mode 41ff mask 3 00000080:00200000:0.0:1782487606.948878:0:295211:0:(namei.c:2317:ll_rmdir()) VFS Op:name=d77r.sanityn, dir=[0x200000007:0x1:0x0](ffff8a6acd3f9148) 00010000:00010000:0.0:1782487606.948895:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.948918:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:0.0:1782487606.948955:0:295211:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff8a6adf731500 x1869066294455552/t8589957023(8589957023) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1782487606.948966:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1782487606.948972:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf730a80 x1869066294459520/t0(0) o35->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1782487606.948993:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730a80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294459520:192.168.202.121@tcp:35:rm.0 00000100:00100000:0.0:1782487606.949051:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79240 going to sleep for 11 seconds 00000100:00100000:0.0:1782487606.950712:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730a80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294459520:192.168.202.121@tcp:35:rm.0 00000002:00100000:0.0:1782487606.950799:0:295211:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8a6adf731500 x1869066294455552/t8589957023(8589957023) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 648/608 e 0 to 0 dl 1782487787 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1782487606.950832:0:295211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6b01dac000/0x43f633357a442331 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x66475b4e8b79b85d expref: -99 pid: 274468 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.950947:0:295211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.950955:0:295211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6b01dac000/0x43f633357a442331 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b79b85d expref: -99 pid: 274468 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.950962:0:295211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.950967:0:295211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1782487606.950970:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af5267800/0x43f633357a478539 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b85eec4 expref: -99 pid: 295211 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.950980:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6b01dac000/0x43f633357a442331 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b79b85d expref: -99 pid: 274468 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487606.950992:0:295211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6aee037200/0x43f633357a442323 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b79b81e expref: -99 pid: 274455 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00100000:0.0:1782487606.951007:0:295211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1782487606.951012:0:295211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf730a80 x1869066294459776/t0(0) o36->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782487606.951027:0:295211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730a80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294459776:192.168.202.121@tcp:36:rm.0 00000100:00100000:0.0:1782487606.951069:0:295211:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ad0b79240 going to sleep for 176 seconds 00000100:00100000:2.0:1782487606.953065:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:3.0:1782487606.953153:0:261162:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299323520 00000100:00100000:3.0:1782487606.953159:0:261162:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299323520 00000100:00100000:3.0:1782487606.953249:0:261162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5557 00000100:00100000:3.0:1782487606.953259:0:261162:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213218:x1869066299323520:12345-192.168.202.121@tcp:104: 00010000:00010000:3.0:1782487606.953273:0:261162:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee036000/0x43f633357a442426 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x66475b4e8b79bbcf expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1782487606.953329:0:261162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782487606.953344:0:261162:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213218:x1869066299323520:12345-192.168.202.121@tcp:104: Request processed in 80us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782487606.953352:0:261162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5557 00010000:00010000:0.0:1782487606.953393:0:261832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487606.953400:0:261832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee036000/0x43f633357a442426 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x66475b4e8b79bbcf expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.953416:0:261832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aee036000 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487606.953423:0:261832:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee036000/0x43f633357a442426 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x66475b4e8b79bbcf expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.953432:0:261832:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee036000/0x43f633357a442426 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x66475b4e8b79bbcf expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.953440:0:261832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee036000/0x43f633357a442426 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x66475b4e8b79bbcf expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.953475:0:261832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee036000/0x43f633357a442426 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x66475b4e8b79bbcf expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.953481:0:261832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.953506:0:261832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee036000/0x43f633357a442426 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x66475b4e8b79bbcf expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.953513:0:261832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6aee036000/0x43f633357a442426 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x66475b4e8b79bbcf expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1782487606.953529:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.953530:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.953539:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782487606.953679:0:2360:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782487606.953692:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294459904:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782487606.955301:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294459904:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487606.955943:0:2354:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487606.956246:0:266186:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299323648 00000100:00100000:2.0:1782487606.956253:0:266186:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299323648 00000100:00100000:2.0:1782487606.956293:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5558 00000100:00100000:2.0:1782487606.956301:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aebecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213218:x1869066299323648:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487606.956314:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af1e76600/0x43f633357a442434 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x66475b4e8b79bc07 expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782487606.956406:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487606.956414:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aebecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:5c4ca15f-f34e-4111-b105-de67ffe3ec92+5:213218:x1869066299323648:12345-192.168.202.121@tcp:104: Request processed in 113us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487606.956421:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5558 00010000:00010000:0.0:1782487606.956945:0:261170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487606.956952:0:261170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af1e76600/0x43f633357a442434 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x66475b4e8b79bc07 expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.956978:0:261170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af1e76600 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487606.956983:0:261170:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af1e76600/0x43f633357a442434 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x66475b4e8b79bc07 expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.956992:0:261170:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af1e76600/0x43f633357a442434 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x66475b4e8b79bc07 expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.957000:0:261170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af1e76600/0x43f633357a442434 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x66475b4e8b79bc07 expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.957038:0:261170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af1e76600/0x43f633357a442434 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x66475b4e8b79bc07 expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.957045:0:261170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487606.957062:0:261170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af1e76600/0x43f633357a442434 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x66475b4e8b79bc07 expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.957070:0:261170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af1e76600/0x43f633357a442434 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x35:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x66475b4e8b79bc07 expref: -99 pid: 274511 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487606.957084:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.957086:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487606.957089:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487606.957096:0:2361:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487606.957108:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294460032:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782487606.963340:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294460032:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487606.963627:0:295211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730a80 pname:cluuid:pid:xid:nid:opc:job rm:838f7623-bf1c-484f-8afd-fb26a1863ad0:295211:1869066294459776:192.168.202.121@tcp:36:rm.0 00010000:00010000:3.0:1782487607.598958:0:261169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487607.725828:0:291806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487607.725843:0:291806:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487607.725948:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294460160:192.168.202.121@tcp:63:ll_sa.0 00010000:00010000:3.0:1782487607.728048:0:2363:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728095:0:2363:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728102:0:2363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728110:0:2363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728118:0:2363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728140:0:2363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac524c200 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:3.0:1782487607.728145:0:2363:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x206400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728152:0:2363:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x206400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728160:0:2363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x20e400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728167:0:2363:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782487607.728173:0:2363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487607.728180:0:2363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a47855c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 291806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487607.728212:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294460160:192.168.202.121@tcp:63:ll_sa.0 00000100:00100000:2.0:1782487608.523786:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487608.523826:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487608.523862:0:261161:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299324288 00000100:00100000:2.0:1782487608.523871:0:261161:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299324288 00000100:00100000:2.0:1782487608.523911:0:261161:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299324416 00000100:00100000:2.0:1782487608.523914:0:261161:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299324416 00000100:00100000:2.0:1782487608.523929:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5559 00000100:00100000:2.0:1782487608.523938:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace29b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:192482:x1869066299324288:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487608.523955:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 00000000d8d63917/0x43f633357a4784ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000010000 nid: local remote: 0x66475b4e8b85e253 expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524028:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487608.524035:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace29b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:192482:x1869066299324288:12345-192.168.202.121@tcp:104: Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487608.524043:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5559 00000100:00100000:2.0:1782487608.524061:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5560 00000100:00100000:2.0:1782487608.524068:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ace29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:213220:x1869066299324416:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487608.524076:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 0000000066b26f8e/0x43f633357a4784a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000010000 nid: local remote: 0x66475b4e8b85e24c expref: -99 pid: 294634 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524107:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782487608.524113:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ace29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:213220:x1869066299324416:12345-192.168.202.121@tcp:104: Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487608.524120:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5560 00010000:00010000:2.0:1782487608.524139:0:265367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782487608.524145:0:265367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 00000000d8d63917/0x43f633357a4784ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000010000 nid: local remote: 0x66475b4e8b85e253 expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524154:0:265367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aef9abc00 already unused, calling callback (ffffffffc126e370) 00010000:00010000:2.0:1782487608.524166:0:265367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 00000000d8d63917/0x43f633357a4784ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400010000 nid: local remote: 0x66475b4e8b85e253 expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782487608.524216:0:265367:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd2:0xb17:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1782487608.524238:0:265367:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd2:0xb17:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1782487608.524294:0:265367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 00000000d8d63917/0x43f633357a4784ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e253 expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524303:0:265367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782487608.524328:0:265367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 00000000d8d63917/0x43f633357a4784ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e253 expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524337:0:265367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 00000000d8d63917/0x43f633357a4784ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1884:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e253 expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524356:0:265367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782487608.524359:0:265367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 0000000066b26f8e/0x43f633357a4784a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000010000 nid: local remote: 0x66475b4e8b85e24c expref: -99 pid: 294634 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524366:0:265367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac2c60000 already unused, calling callback (ffffffffc126e370) 00010000:00010000:2.0:1782487608.524369:0:265367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 0000000066b26f8e/0x43f633357a4784a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400010000 nid: local remote: 0x66475b4e8b85e24c expref: -99 pid: 294634 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1782487608.524394:0:265367:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd2:0xb15:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1782487608.524399:0:265367:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd2:0xb15:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1782487608.524428:0:265367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 0000000066b26f8e/0x43f633357a4784a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e24c expref: -99 pid: 294634 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524441:0:265367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782487608.524449:0:265367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 0000000066b26f8e/0x43f633357a4784a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e24c expref: -99 pid: 294634 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524457:0:265367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff8a6ac800b000 lock: 0000000066b26f8e/0x43f633357a4784a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1883:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e24c expref: -99 pid: 294634 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487608.524472:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487608.524474:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782487608.524476:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487608.524776:0:2362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2362:1869066294460288:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487608.524840:0:2362:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782487608.524848:0:2362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2362:1869066294460416:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782487608.525473:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782487608.528553:0:2362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2362:1869066294460416:192.168.202.121@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782487608.528567:0:2362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2362:1869066294460288:192.168.202.121@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782487608.627363:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487609.648399:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1782487610.286175:0:258801:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9be:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.286191:0:258801:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.286251:0:258801:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9be:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.286276:0:258801:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9d3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.286282:0:258801:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.286300:0:258801:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9d3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.286325:0:258801:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9e7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.286330:0:258801:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.286345:0:258801:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9e7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.286356:0:258801:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9fb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.286359:0:258801:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.286368:0:258801:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9fb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.286378:0:258801:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9ff:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.286380:0:258801:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.286389:0:258801:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9ff:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.286398:0:258801:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa10:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.286400:0:258801:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.286409:0:258801:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa10:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1782487610.670884:0:261169:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1782487610.798068:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x988:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798084:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798142:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x988:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798184:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x98f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798190:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798233:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x98f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798262:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x990:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798267:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798295:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x990:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798328:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x991:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798333:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798359:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x991:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798386:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x994:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798390:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798415:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x994:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798439:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x99c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798443:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798464:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x99c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798483:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x99b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798488:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798508:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x99b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798529:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x99d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798534:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798555:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x99d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798575:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9a3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798580:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798598:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9a3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798616:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9b7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798621:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798637:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9b7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798653:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9b5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798656:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798671:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9b5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.798685:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9c1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.798689:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.798705:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9c1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800289:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9bf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800300:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800331:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9bf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800350:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9c8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800355:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800372:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9c8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800390:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9d7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800394:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800412:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9d7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800428:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9db:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800433:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800449:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9db:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800467:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9eb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800471:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800487:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9eb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800504:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9f0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800509:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800525:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9f0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800540:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9ee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800544:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800558:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9ee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800575:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9ef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800579:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800597:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9ef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800613:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9f3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800617:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800633:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9f3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800657:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9fa:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800661:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.800679:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9fa:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.800710:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9fd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.800715:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801263:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9fd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801282:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0x9fc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801287:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801307:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0x9fc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801325:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa01:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801328:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801342:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa01:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801352:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa02:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801354:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801367:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa02:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801378:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa04:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801380:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801392:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa04:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801410:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa05:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801413:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801424:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa05:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801435:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa09:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801438:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801448:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa09:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801459:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa0d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801462:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801475:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa0d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801495:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa12:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801499:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801511:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa12:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801522:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa14:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801525:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801535:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa14:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801547:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa16:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801550:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801562:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa16:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801576:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa1b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801578:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801591:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa1b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801609:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa18:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801613:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801634:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa18:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801652:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa23:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801657:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801673:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa23:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801686:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa27:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801691:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801710:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa27:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801763:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa2c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801768:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801790:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa2c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801815:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa2e:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801819:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801840:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa2e:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801873:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa30:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801879:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801902:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa30:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801923:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa2f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801927:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801953:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa2f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.801974:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa34:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.801978:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.801992:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa34:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.802004:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa3c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.802007:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.802019:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa3c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.802038:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa3f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.802043:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.802062:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa3f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.802084:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa40:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.802089:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.802108:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa40:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782487610.802129:0:295206:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd1:0xa42:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1782487610.802134:0:295206:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1782487610.802155:0:295206:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd1:0xa42:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000001:02000400:2.0:1782487611.115012:0:295482:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77s: Check TBF LRU shrinker ============== 11:26:50 (1782487610) 00000080:00200000:2.0:1782487611.189253:0:295491:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:2.0:1782487611.189277:0:295491:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1782487611.189335:0:295491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487611.189346:0:295491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782487611.189356:0:295491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782487611.189377:0:295491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ace298380 pname:cluuid:pid:xid:nid:opc:job lfs:838f7623-bf1c-484f-8afd-fb26a1863ad0:295491:1869066294460544:192.168.202.121@tcp:101:lfs.0 00000100:00100000:2.0:1782487611.189463:0:295491:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6aca944c00 going to sleep for 176 seconds 00000100:00100000:3.0:1782487611.201434:0:295491:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8a6ad0efd000: committing for last_committed 8589957029 gen 1 00000100:00100000:3.0:1782487611.201466:0:295491:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6ace298380 pname:cluuid:pid:xid:nid:opc:job lfs:838f7623-bf1c-484f-8afd-fb26a1863ad0:295491:1869066294460544:192.168.202.121@tcp:101:lfs.0 00010000:00010000:3.0:1782487611.201486:0:295491:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.201510:0:295491:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.201521:0:295491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.201532:0:295491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.201544:0:295491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.201553:0:295491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.201561:0:295491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782487611.201571:0:295491:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8a6ace298380 x1869066294460544/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1782487792 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782487611.201584:0:295491:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.201595:0:295491:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff8a6aca90a400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1782487611.201601:0:295491:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1782487611.201624:0:295491:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 71168 00000080:00010000:3.0:1782487611.201633:0:295491:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a478563 00000080:00010000:3.0:1782487611.201638:0:295491:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:3.0:1782487611.201641:0:295491:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478563 from it ffff99a4c1fdbb58 00010000:00010000:3.0:1782487611.201645:0:295491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.201654:0:295491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782487611.201672:0:295491:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148), inode mode 41ff mask 1 00000080:00200000:3.0:1782487611.201684:0:295491:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d77s.sanityn, dir=[0x200000007:0x1:0x0](ffff8a6acd3f9148), flags=13 00000080:00200000:3.0:1782487611.201689:0:295491:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d77s.sanityn, dir=[0x200000007:0x1:0x0](ffff8a6acd3f9148), intent=getattr 00000002:00010000:3.0:1782487611.201706:0:295491:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d77s.sanityn,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 01 00010000:00010000:3.0:1782487611.202433:0:295491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.202443:0:295491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.202452:0:295491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487611.202470:0:295491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebec9880 pname:cluuid:pid:xid:nid:opc:job lfs:838f7623-bf1c-484f-8afd-fb26a1863ad0:295491:1869066294460672:192.168.202.121@tcp:101:lfs.0 00000100:00100000:3.0:1782487611.202583:0:295491:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6aee2e8c00 going to sleep for 176 seconds 00000100:00100000:0.0:1782487611.209646:0:295491:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebec9880 pname:cluuid:pid:xid:nid:opc:job lfs:838f7623-bf1c-484f-8afd-fb26a1863ad0:295491:1869066294460672:192.168.202.121@tcp:101:lfs.0 00010000:00010000:0.0:1782487611.209667:0:295491:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209680:0:295491:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209688:0:295491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209695:0:295491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209704:0:295491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209709:0:295491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af81df400 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487611.209714:0:295491:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209744:0:295491:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209752:0:295491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209759:0:295491:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1782487611.209765:0:295491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.209782:0:295491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81df400/0x43f633357a47856a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 295491 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782487611.209803:0:295491:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8a6aebec9880 x1869066294460672/t0(0) o101->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 584/584 e 0 to 0 dl 1782487792 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1782487611.209817:0:295491:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1782487611.209839:0:295491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487611.209851:0:295491:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1782487611.209860:0:295491:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478563 from it ffff99a4c1fdb930 00010000:00010000:0.0:1782487611.209864:0:295491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782487611.209872:0:295491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782487611.209926:0:295491:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:0.0:1782487611.209938:0:295491:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782487611.209944:0:295491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487611.209952:0:295491:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782487611.209968:0:295491:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782487611.209973:0:295491:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:0.0:1782487611.209976:0:295491:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a478563 00000080:00010000:0.0:1782487611.209982:0:295491:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478563 from it ffff99a4c1fdbbe8 00010000:00010000:0.0:1782487611.209985:0:295491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487611.209992:0:295491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1782487611.210000:0:295491:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148), inode mode 41ff mask 1 00000080:00200000:0.0:1782487611.210006:0:295491:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77s.sanityn, flags=16392 00000080:00200008:0.0:1782487611.210026:0:295491:0:(file.c:6217:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8a6acd3f9148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1782487611.210031:0:295491:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:0.0:1782487611.210037:0:295491:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782487611.210043:0:295491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782487611.210052:0:295491:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1782487611.210059:0:295491:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782487611.210062:0:295491:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:0.0:1782487611.210065:0:295491:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a478563 00000080:00010000:0.0:1782487611.210068:0:295491:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478563 from it ffff99a4c1fdbcb8 00010000:00010000:0.0:1782487611.210071:0:295491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782487611.210084:0:295491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1782487611.210530:0:295491:0:(file.c:6217:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8a6acd3f9148), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1782487611.210534:0:295491:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:0.0:1782487611.210541:0:295491:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782487611.210548:0:295491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1782487611.210557:0:295491:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1782487611.210563:0:295491:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782487611.210567:0:295491:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:0.0:1782487611.210570:0:295491:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a478563 00000080:00010000:0.0:1782487611.210573:0:295491:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478563 from it ffff99a4c1fdbcb8 00010000:00010000:0.0:1782487611.210577:0:295491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1782487611.210585:0:295491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1782487611.210679:0:295491:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148),name=/ 00000002:00010000:0.0:1782487611.210686:0:295491:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782487611.210692:0:295491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1782487611.210709:0:295491:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1782487611.210732:0:295491:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782487611.210737:0:295491:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) 00000080:00010000:0.0:1782487611.210739:0:295491:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8a6acd3f9148) for lock 0x43f633357a478563 00000080:00010000:0.0:1782487611.210743:0:295491:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x43f633357a478563 from it ffff99a4c1fdbbb0 00010000:00010000:0.0:1782487611.210747:0:295491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1782487611.210755:0:295491:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000080:00200000:0.0:1782487611.210763:0:295491:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148), inode mode 41ff mask 44 00000080:00200008:0.0:1782487611.210769:0:295491:0:(file.c:1058:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8a6acd3f9148), flags 300000 00000080:00200080:0.0:1782487611.210784:0:295491:0:(dir.c:2003:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148) cmd=c03066f0 arg=7ffe259eafc0 00000080:00200000:0.0:1782487611.210796:0:295491:0:(dir.c:451:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8a6acd3f9148) name=d77s.sanityn stripe_offset=0 stripe_count=1, hash_type=0 00010000:00010000:0.0:1782487611.210817:0:295491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1782487611.210863:0:295491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1782487611.210870:0:295491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487611.210873:0:295491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6ac524c200/0x43f633357a478563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x66475b4e8b85efea expref: -99 pid: 295491 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000020:00100000:0.0:1782487611.210904:0:295491:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8a6ad0efd000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1782487611.210912:0:295491:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8a6adf731c00 x1869066294460928/t0(0) o36->lustre-MDT0000-mdc-ffff8a6ad0efd000@192.168.202.121@tcp:12/10 lens 560/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782487611.210934:0:295491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf731c00 pname:cluuid:pid:xid:nid:opc:job lfs:838f7623-bf1c-484f-8afd-fb26a1863ad0:295491:1869066294460928:192.168.202.121@tcp:36:lfs.0 00000100:00100000:0.0:1782487611.211002:0:295491:0:(client.c:2701:ptlrpc_set_wait()) set ffff8a6ac88bef00 going to sleep for 176 seconds 00000100:00100000:0.0:1782487611.216777:0:295491:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf731c00 pname:cluuid:pid:xid:nid:opc:job lfs:838f7623-bf1c-484f-8afd-fb26a1863ad0:295491:1869066294460928:192.168.202.121@tcp:36:lfs.0 00000080:00200000:0.0:1782487611.216820:0:295491:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x200000bd1:0xb4e:0x0](ffff8a6ac21421c8) 00000080:00200000:0.0:1782487611.216827:0:295491:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x200000bd1:0xb4e:0x0], updating i_size 512 00000080:00200008:0.0:1782487611.216852:0:295491:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8a6acd3f9148), flags 300000 00010000:00010000:0.0:1782487611.309903:0:292887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.309918:0:292887:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782487611.310001:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294461056:192.168.202.121@tcp:63:ll_sa.0 00000100:00080000:0.0:1782487611.310147:0:295207:0:(import.c:65:import_set_state_nolock()) ffff8a6ac7da5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:02000000:0.0:1782487611.310152:0:295207:0:(import.c:2103:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8a6ad0efd000: disconnect after 23s idle 00000100:00100000:1.0:1782487611.310161:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60894528-77cf-40cf-92ce-b54cc4bbae30:2360:1869066294461184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1782487611.313705:0:2359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:838f7623-bf1c-484f-8afd-fb26a1863ad0:2359:1869066294461312:192.168.202.121@tcp:9:kworker.0 00000100:00100000:1.0:1782487611.313809:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294461568:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1782487611.313837:0:2360:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782487611.313845:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:838f7623-bf1c-484f-8afd-fb26a1863ad0:2360:1869066294461440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1782487611.313869:0:2360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294461696:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1782487611.315228:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:60894528-77cf-40cf-92ce-b54cc4bbae30:2360:1869066294461184:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1782487611.315558:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294461568:192.168.202.121@tcp:400:kworker.0 00010000:00010000:0.0:1782487611.315925:0:2361:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.315937:0:2361:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.315944:0:2361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.315957:0:2361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.315974:0:2361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.315981:0:2361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af5267600 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:0.0:1782487611.315985:0:2361:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x206400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.315992:0:2361:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x206400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.315998:0:2361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x20e400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.316004:0:2361:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1782487611.316010:0:2361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782487611.316015:0:2361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ac800b000 lock: ffff8a6af5267600/0x43f633357a478571 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 292887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782487611.316036:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294461056:192.168.202.121@tcp:63:ll_sa.0 00000100:00100000:1.0:1782487611.317354:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:838f7623-bf1c-484f-8afd-fb26a1863ad0:2360:1869066294461440:192.168.202.121@tcp:400:kworker.0 00000100:00100000:1.0:1782487611.317386:0:2360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2360:1869066294461696:192.168.202.121@tcp:400:kworker.0 00000100:00080000:0.0:1782487611.317389:0:2359:0:(import.c:2013:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8a6adf730700 x1869066294461312/t0(0) o9->lustre-OST0000-osc-ffff8a6ad0efd000@192.168.202.121@tcp:28/4 lens 224/224 e 0 to 0 dl 1782487621 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782487611.317402:0:2359:0:(import.c:65:import_set_state_nolock()) ffff8a6ac7da5000 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:0.0:1782487611.317407:0:2359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:838f7623-bf1c-484f-8afd-fb26a1863ad0:2359:1869066294461312:192.168.202.121@tcp:9:kworker.0 00010000:00010000:2.0:1782487611.693859:0:265367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782487611.821868:0:292982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.821886:0:292982:0:(ldlm_request.c:1275:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487611.821988:0:2363:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782487611.822006:0:2363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aebec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294461824:192.168.202.121@tcp:63: 00010000:00010000:3.0:1782487611.826287:0:2363:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826304:0:2363:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826311:0:2363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826370:0:2363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826380:0:2363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826387:0:2363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af81dfe00 already unused, calling callback (ffffffffc1b9bfa0) 00010000:00010000:3.0:1782487611.826391:0:2363:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x206400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826398:0:2363:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x206400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826405:0:2363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x20e400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826411:0:2363:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782487611.826417:0:2363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782487611.826439:0:2363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8a6ad0efd000 lock: ffff8a6af81dfe00/0x43f633357a478578 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x35:0x0].0x0 bits 0x3/0x3 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 292982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782487611.826475:0:2363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6aebec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:838f7623-bf1c-484f-8afd-fb26a1863ad0:2363:1869066294461824:192.168.202.121@tcp:63: 00010000:00010000:0.0:1782487612.717910:0:265368:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782487613.522346:0:295655:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_77s: @@@@@@ FAIL: fail to start 'tbf jobid' policy 00000100:00100000:3.0:1782487613.635436:0:2355:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.121@tcp (source: 12345-192.168.202.121@tcp) 00000100:00100000:2.0:1782487613.635480:0:261161:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066299325696 00000100:00100000:2.0:1782487613.635498:0:261161:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066299325696 00000100:00100000:2.0:1782487613.635564:0:261161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.121@tcp, seq: 5561 00000100:00100000:2.0:1782487613.635574:0:261161:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aebec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:213213:x1869066299325696:12345-192.168.202.121@tcp:104: 00010000:00010000:2.0:1782487613.635592:0:261161:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff8a6ac800b000 lock: 00000000d9a9e24f/0x43f633357a4784b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000010000 nid: local remote: 0x66475b4e8b85e25a expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1782487613.635663:0:261161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782487613.635671:0:261161:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aebec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:213213:x1869066299325696:12345-192.168.202.121@tcp:104: Request processed in 98us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782487613.635679:0:261161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.121@tcp, seq: 5561 00010000:00010000:0.0:1782487613.635946:0:261832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782487613.635959:0:261832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff8a6ac800b000 lock: 00000000d9a9e24f/0x43f633357a4784b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000010000 nid: local remote: 0x66475b4e8b85e25a expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487613.635970:0:261832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6af81df800 already unused, calling callback (ffffffffc126e370) 00010000:00010000:0.0:1782487613.635977:0:261832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff8a6ac800b000 lock: 00000000d9a9e24f/0x43f633357a4784b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400010000 nid: local remote: 0x66475b4e8b85e25a expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782487613.636034:0:261832:0:(vvp_io.c:1822:vvp_io_init()) [0x200000bd2:0xb16:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1782487613.636045:0:261832:0:(vvp_io.c:304:vvp_io_fini()) [0x200000bd2:0xb16:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1782487613.636102:0:261832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff8a6ac800b000 lock: 00000000d9a9e24f/0x43f633357a4784b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e25a expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487613.636111:0:261832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782487613.636140:0:261832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff8a6ac800b000 lock: 00000000d9a9e24f/0x43f633357a4784b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e25a expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487613.636149:0:261832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff8a6ac800b000 lock: 00000000d9a9e24f/0x43f633357a4784b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x185d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x66475b4e8b85e25a expref: -99 pid: 294631 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782487613.636184:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487613.636187:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782487613.636188:0:261832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782487613.636196:0:2361:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782487613.636210:0:2361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8a6adf730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294461952:192.168.202.121@tcp:103: 00000100:00100000:0.0:1782487613.637586:0:2361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8a6adf730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c4ca15f-f34e-4111-b105-de67ffe3ec92:2361:1869066294461952:192.168.202.121@tcp:103: 00010000:00010000:3.0:1782487613.743926:0:261170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1483 lines, 1483 kept, 0 dropped, 0 bad.