00010000:00010000:0.0F:1767323385.031672:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767323385.545512:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111001:1853171975808640:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323385.551212:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767323385.551246:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975808768:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0F:1767323385.552191:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1767323385.552221:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975808896:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323385.556606:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111001:1853171975808640:192.168.204.130@tcp:400:kworker.0 00010000:00080000:1.0:1767323385.564993:0:111004:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941010e3e300 x1853171975808896/t0(0) o400->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323385.565019:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975808896:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0F:1767323385.565514:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975808768:192.168.204.130@tcp:400:kworker.0 00010000:00010000:3.0F:1767323386.055610:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323387.081348:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323388.104630:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1767323388.221135:0:127075:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-lfsck test 18e: Find out orphan OST-object and repair it (5) ========================================================== 22:09:46 (1767323386) 00000080:00200000:1.0:1767323388.328194:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323388.328234:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323388.328341:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323388.328360:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323388.328369:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323388.328378:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323388.328485:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b55675d 00000080:00010000:1.0:1767323388.328496:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55675d from it ffffb75487e7bbb0 00010000:00010000:1.0:1767323388.328500:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323388.328511:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323388.328532:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767323388.328542:0:126943:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), flags 304000 00000080:00200008:1.0:1767323388.328560:0:126943:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), request_mask 2047, flags 0, foreign 0 00000002:00010000:1.0:1767323388.328578:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: readdir flags 0 00010000:00010000:1.0:1767323388.328587:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323388.328604:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767323388.330354:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3e300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975809024:192.168.204.130@tcp:37:bash.0 00000100:00100000:1.0:1767323388.330543:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088dee40 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.341967:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3e300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975809024:192.168.204.130@tcp:37:bash.0 00010000:00010000:2.0:1767323388.343884:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.343907:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.343947:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.343974:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.343990:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.344003:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.344012:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.344019:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.344023:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b55675d 00000080:00010000:2.0:1767323388.344030:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55675d from it ffffb75487e7bcd8 00010000:00010000:2.0:1767323388.344034:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.344042:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.344137:0:126943:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1767323388.344217:0:126943:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:2.0:1767323388.344254:0:126943:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), flags 304000 00000080:00200000:3.0:1767323388.349497:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:3.0:1767323388.349543:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.349568:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.349587:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.349596:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323388.349605:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:3.0:1767323388.349609:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b55675d 00000080:00010000:3.0:1767323388.349619:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55675d from it ffffb75488013b58 00010000:00010000:3.0:1767323388.349624:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.349634:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.349653:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.349668:0:127091:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d18d.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), flags=8 00000080:00200000:3.0:1767323388.349672:0:127091:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d18d.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), intent=getattr 00000002:00010000:3.0:1767323388.349686:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d18d.sanity-lfsck,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.349747:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.349755:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.349778:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:3.0:1767323388.349811:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809152:192.168.204.130@tcp:101:rm.0 00000100:00100000:3.0:1767323388.354660:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.373242:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809152:192.168.204.130@tcp:101:rm.0 00010000:00010000:0.0:1767323388.373271:0:127091:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373426:0:127091:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373436:0:127091:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373448:0:127091:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373463:0:127091:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373476:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373484:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373515:0:127091:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767323388.373527:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9410118e9c00 x1853171975809152/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/688 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767323388.373542:0:127091:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373553:0:127091:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589935618/126 (0 0) 00000080:00200000:0.0:1767323388.373560:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767323388.373605:0:127091:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8) 00000080:00200000:0.0:1767323388.373616:0:127091:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7e:0x0], updating i_size 4096 00000080:00010000:0.0:1767323388.373623:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) for lock 0x720c8b170b55676b 00000080:00010000:0.0:1767323388.373637:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) 00000080:00010000:0.0:1767323388.373641:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55676b from it ffffb75488013b20 00010000:00010000:0.0:1767323388.373644:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.373653:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767323388.373694:0:127091:0:(file.c:6252:ll_getattr_dentry()) START file d18d.sanity-lfsck:[0x200000402:0x7e:0x0](ffff9410411d21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767323388.373701:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8),name=d18d.sanity-lfsck 00000100:00100000:0.0:1767323388.373759:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809280:192.168.204.130@tcp:900:rm.0 00000100:00100000:0.0:1767323388.374005:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530d80 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.380905:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809280:192.168.204.130@tcp:900:rm.0 00000002:00010000:0.0:1767323388.380966:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.380984:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.380999:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.381010:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.381019:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) 00000080:00010000:0.0:1767323388.381024:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) for lock 0x720c8b170b55676b 00000080:00010000:0.0:1767323388.381032:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55676b from it ffffb75488013cb8 00010000:00010000:0.0:1767323388.381120:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.381132:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.381217:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.381234:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.381242:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.381252:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.381258:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.381264:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.381267:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b55675d 00000080:00010000:0.0:1767323388.381271:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55675d from it ffffb75488013bf8 00010000:00010000:0.0:1767323388.381283:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.381302:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.381312:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.381320:0:127091:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18d.sanity-lfsck, flags=266 00000080:00200000:0.0:1767323388.381328:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767323388.381337:0:127091:0:(file.c:1001:ll_file_open()) START file d18d.sanity-lfsck:[0x200000402:0x7e:0x0](ffff9410411d21c8), flags 704400 00000002:00010000:0.0:1767323388.381355:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1767323388.381448:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:0.0:1767323388.381456:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000020:00100000:0.0:1767323388.381468:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767323388.381476:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941011be5180 x1853171975809536/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767323388.381486:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:0.0:1767323388.381509:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809536:192.168.204.130@tcp:101:rm.0 00000100:00100000:0.0:1767323388.381700:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530d80 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.401344:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809536:192.168.204.130@tcp:101:rm.0 00010000:00010000:3.0:1767323388.401376:0:127091:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401425:0:127091:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401433:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401442:0:127091:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401451:0:127091:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401858:0:127091:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941010aef400 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:3.0:1767323388.401864:0:127091:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401879:0:127091:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401895:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401904:0:127091:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767323388.401921:0:127091:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.401928:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b556772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127091 initiator: MDT0 00000002:00100000:3.0:1767323388.401949:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff941011be5180 x1853171975809536/t8589934597(8589934597) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767323388.401964:0:127091:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941011be5180 x1853171975809536/t8589934597(8589934597) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.402194:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767323388.402231:0:127091:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7e:0x0], updating i_size 4096 00000002:00100000:3.0:1767323388.402565:0:127091:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941011be5180 x1853171975809536/t8589934597(8589934597) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767323388.402639:0:127091:0:(file.c:6252:ll_getattr_dentry()) START file d18d.sanity-lfsck:[0x200000402:0x7e:0x0](ffff9410411d21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767323388.402648:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8),name=d18d.sanity-lfsck 00000002:00010000:3.0:1767323388.402675:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.402693:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.402706:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.402715:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323388.402722:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) 00000080:00010000:3.0:1767323388.402726:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) for lock 0x720c8b170b55676b 00000080:00010000:3.0:1767323388.402732:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55676b from it ffffb75488013cd8 00010000:00010000:3.0:1767323388.402736:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.402751:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.403691:0:127091:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8) pos/size0/4096 32bit_api 0 00000002:00010000:3.0:1767323388.403719:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7e:0x0]) in obj [0x200000402:0x7e:0x0], intent: readdir flags 0 00010000:00010000:3.0:1767323388.403730:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.403743:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1767323388.407780:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809664:192.168.204.130@tcp:37:rm.0 00000100:00100000:3.0:1767323388.408559:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.421928:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809664:192.168.204.130@tcp:37:rm.0 00010000:00010000:3.0:1767323388.423152:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.423174:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1767323388.423348:0:127091:0:(file.c:424:ll_file_release()) START file d18d.sanity-lfsck:[0x200000402:0x7e:0x0](ffff9410411d21c8), flags 704000 00000002:00100000:2.0:1767323388.426669:0:127091:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941011be5180 x1853171975809536/t8589934597(8589934597) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767323388.426692:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767323388.426700:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff94101813b800 x1853171975809920/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767323388.426730:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b800 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809920:192.168.204.130@tcp:35:rm.0 00000100:00100000:2.0:1767323388.426861:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.430899:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b800 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975809920:192.168.204.130@tcp:35:rm.0 00000002:00100000:2.0:1767323388.430945:0:127091:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941011be5180 x1853171975809536/t8589934597(8589934597) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.431057:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.431080:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.431110:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.431126:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.431135:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.431141:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.431146:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b55675d 00000080:00010000:2.0:1767323388.431154:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55675d from it ffffb75488013bf8 00010000:00010000:2.0:1767323388.431158:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.431168:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.431198:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.431205:0:127091:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18d.sanity-lfsck, flags=266 00000080:00200000:2.0:1767323388.431213:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8), inode mode 41ed mask 44 00000080:00200008:2.0:1767323388.431222:0:127091:0:(file.c:1001:ll_file_open()) START file d18d.sanity-lfsck:[0x200000402:0x7e:0x0](ffff9410411d21c8), flags 704400 00000002:00010000:2.0:1767323388.431240:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:2.0:1767323388.431307:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.431315:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000020:00100000:2.0:1767323388.431327:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767323388.431333:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff94101813b800 x1853171975810176/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767323388.431343:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:2.0:1767323388.431364:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b800 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810176:192.168.204.130@tcp:101:rm.0 00000100:00100000:2.0:1767323388.431629:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.436660:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b800 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810176:192.168.204.130@tcp:101:rm.0 00010000:00010000:2.0:1767323388.436700:0:127091:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.436714:0:127091:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.436727:0:127091:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.436755:0:127091:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.436772:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff94101813b800 x1853171975810176/t8589934599(8589934599) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767323388.436785:0:127091:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff94101813b800 x1853171975810176/t8589934599(8589934599) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.436803:0:127091:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.436813:0:127091:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 16 res 8589935618/126 (0 0) 00000080:00200000:2.0:1767323388.436820:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767323388.436852:0:127091:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7e:0x0], updating i_size 4096 00000080:00010000:2.0:1767323388.436859:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) for lock 0x720c8b170b556779 00000080:00010000:2.0:1767323388.436879:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556779 from it ffffb75488013bd0 00010000:00010000:2.0:1767323388.436884:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.436970:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.437053:0:127091:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff94101813b800 x1853171975810176/t8589934599(8589934599) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767323388.437351:0:127091:0:(file.c:6252:ll_getattr_dentry()) START file d18d.sanity-lfsck:[0x200000402:0x7e:0x0](ffff9410411d21c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767323388.437361:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8),name=d18d.sanity-lfsck 00000002:00010000:2.0:1767323388.437416:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.437433:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.437447:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.437778:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.437787:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) 00000080:00010000:2.0:1767323388.437791:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) for lock 0x720c8b170b55676b 00000080:00010000:2.0:1767323388.437796:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55676b from it ffffb75488013cd8 00010000:00010000:2.0:1767323388.437800:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.437810:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.438093:0:127091:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1767323388.438365:0:127091:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:2.0:1767323388.438571:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.438592:0:127091:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=a1, dir=[0x200000402:0x7e:0x0](ffff9410411d21c8), flags=0 00000080:00200000:2.0:1767323388.438598:0:127091:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=a1, dir=[0x200000402:0x7e:0x0](ffff9410411d21c8), intent=getattr 00000002:00010000:2.0:1767323388.438620:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: a1,[0x0:0x0:0x0]) in obj [0x200000402:0x7e:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.438684:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.438693:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.438704:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:2.0:1767323388.438747:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810304:192.168.204.130@tcp:101:rm.0 00000100:00100000:2.0:1767323388.438921:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.445721:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810304:192.168.204.130@tcp:101:rm.0 00010000:00010000:2.0:1767323388.445755:0:127091:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.445785:0:127091:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.445794:0:127091:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.445807:0:127091:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.445818:0:127091:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.445832:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.445840:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.445849:0:127091:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.445861:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff941018138000 x1853171975810304/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.445918:0:127091:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.445930:0:127091:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589935618/127 (0 0) 00000080:00200000:2.0:1767323388.445938:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x7e:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.445975:0:127091:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348) 00000080:00200000:2.0:1767323388.445984:0:127091:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7f:0x0], updating i_size 4096 00000080:00010000:2.0:1767323388.445991:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) for lock 0x720c8b170b556780 00000080:00010000:2.0:1767323388.446013:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) 00000080:00010000:2.0:1767323388.446016:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556780 from it ffffb75488013b20 00010000:00010000:2.0:1767323388.446020:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.446029:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767323388.446075:0:127091:0:(file.c:6252:ll_getattr_dentry()) START file a1:[0x200000402:0x7f:0x0](ffff941004bd5348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767323388.446993:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348),name=a1 00000002:00010000:2.0:1767323388.447023:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7f:0x0]) in obj [0x200000402:0x7e:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.447036:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.447051:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.447059:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x7e:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.447064:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) 00000080:00010000:2.0:1767323388.447067:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) for lock 0x720c8b170b556780 00000080:00010000:2.0:1767323388.447078:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556780 from it ffffb75488013cb8 00010000:00010000:2.0:1767323388.447081:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.447086:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.447150:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.447158:0:127091:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=258 00000080:00200000:2.0:1767323388.447171:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348), inode mode 41ed mask 44 00000080:00200008:2.0:1767323388.447181:0:127091:0:(file.c:1001:ll_file_open()) START file a1:[0x200000402:0x7f:0x0](ffff941004bd5348), flags 704400 00000002:00010000:2.0:1767323388.447198:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7f:0x0]) in obj [0x200000402:0x7e:0x0], intent: open flags 0100240704401 00010000:00010000:2.0:1767323388.447260:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.447268:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000020:00100000:2.0:1767323388.447281:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767323388.447293:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138000 x1853171975810560/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767323388.447303:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:2.0:1767323388.447330:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810560:192.168.204.130@tcp:101:rm.0 00000100:00100000:2.0:1767323388.447626:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.451990:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810560:192.168.204.130@tcp:101:rm.0 00010000:00010000:2.0:1767323388.452020:0:127091:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452057:0:127091:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452064:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452072:0:127091:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452081:0:127091:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452089:0:127091:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941006a32200 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323388.452094:0:127091:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452101:0:127091:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452109:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 5/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452116:0:127091:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323388.452124:0:127091:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.452131:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b556787 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 127091 initiator: MDT0 00000002:00100000:2.0:1767323388.452152:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff941018138000 x1853171975810560/t8589934600(8589934600) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767323388.452167:0:127091:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941018138000 x1853171975810560/t8589934600(8589934600) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.452186:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000402:0x7e:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767323388.452210:0:127091:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7f:0x0], updating i_size 4096 00000002:00100000:2.0:1767323388.452235:0:127091:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941018138000 x1853171975810560/t8589934600(8589934600) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767323388.452306:0:127091:0:(file.c:6252:ll_getattr_dentry()) START file a1:[0x200000402:0x7f:0x0](ffff941004bd5348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767323388.452314:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348),name=a1 00000002:00010000:2.0:1767323388.452335:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7f:0x0]) in obj [0x200000402:0x7e:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.452350:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.452360:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.452365:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x7e:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.452370:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) 00000080:00010000:2.0:1767323388.452372:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) for lock 0x720c8b170b556780 00000080:00010000:2.0:1767323388.452377:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556780 from it ffffb75488013cd8 00010000:00010000:2.0:1767323388.452379:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.452429:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.452467:0:127091:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348) pos/size0/4096 32bit_api 0 00000002:00010000:2.0:1767323388.452482:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7f:0x0]) in obj [0x200000402:0x7f:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767323388.452488:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.452508:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767323388.453079:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810688:192.168.204.130@tcp:37:rm.0 00000100:00100000:2.0:1767323388.453195:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.467507:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810688:192.168.204.130@tcp:37:rm.0 00010000:00010000:2.0:1767323388.468289:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.468304:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767323388.468359:0:127091:0:(file.c:424:ll_file_release()) START file a1:[0x200000402:0x7f:0x0](ffff941004bd5348), flags 704000 00000002:00100000:2.0:1767323388.468482:0:127091:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941018138000 x1853171975810560/t8589934600(8589934600) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767323388.468496:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767323388.468504:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff94101813b480 x1853171975810944/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767323388.468528:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810944:192.168.204.130@tcp:35:rm.0 00000100:00100000:2.0:1767323388.468616:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.472517:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975810944:192.168.204.130@tcp:35:rm.0 00000002:00100000:2.0:1767323388.472553:0:127091:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941018138000 x1853171975810560/t8589934600(8589934600) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.472629:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.472652:0:127091:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=258 00000080:00200000:2.0:1767323388.472663:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348), inode mode 41ed mask 44 00000080:00200008:2.0:1767323388.472670:0:127091:0:(file.c:1001:ll_file_open()) START file a1:[0x200000402:0x7f:0x0](ffff941004bd5348), flags 704400 00000002:00010000:2.0:1767323388.472691:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7f:0x0]) in obj [0x200000402:0x7e:0x0], intent: open flags 0104240704401 00010000:00010000:2.0:1767323388.472745:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.472753:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000020:00100000:2.0:1767323388.472763:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767323388.472769:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff94101813b480 x1853171975811200/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767323388.472778:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:2.0:1767323388.472796:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811200:192.168.204.130@tcp:101:rm.0 00000100:00100000:2.0:1767323388.472978:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.478647:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811200:192.168.204.130@tcp:101:rm.0 00010000:00010000:2.0:1767323388.478683:0:127091:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.478694:0:127091:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.478705:0:127091:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.478715:0:127091:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.478749:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff94101813b480 x1853171975811200/t8589934602(8589934602) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767323388.478762:0:127091:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff94101813b480 x1853171975811200/t8589934602(8589934602) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.478772:0:127091:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.478782:0:127091:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 16 res 8589935618/127 (0 0) 00000080:00200000:2.0:1767323388.478788:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000402:0x7e:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767323388.478809:0:127091:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7f:0x0], updating i_size 4096 00000080:00010000:2.0:1767323388.478814:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) for lock 0x720c8b170b55678e 00000080:00010000:2.0:1767323388.478825:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55678e from it ffffb75488013bd0 00010000:00010000:2.0:1767323388.478829:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.478839:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.478879:0:127091:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff94101813b480 x1853171975811200/t8589934602(8589934602) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1767323388.478941:0:127091:0:(file.c:6252:ll_getattr_dentry()) START file a1:[0x200000402:0x7f:0x0](ffff941004bd5348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767323388.478948:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348),name=a1 00000002:00010000:2.0:1767323388.478967:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x7f:0x0]) in obj [0x200000402:0x7e:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.478976:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.478996:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.479002:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x7e:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.479008:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) 00000080:00010000:2.0:1767323388.479011:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) for lock 0x720c8b170b556780 00000080:00010000:2.0:1767323388.479015:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556780 from it ffffb75488013cd8 00010000:00010000:2.0:1767323388.479019:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.479025:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.479068:0:127091:0:(llite_lib.c:2766:ll_statfs()) VFS Op:sb=lustre (ffff9410107bd800) a1 proj=0 00000080:00000004:2.0:1767323388.479073:0:127091:0:(obd_class.h:1083:obd_statfs()) lustre-clilmv-ffff9410107bd800: age 5796, max_age 5937 00800000:00000004:2.0:1767323388.479083:0:127091:0:(obd_class.h:1083:obd_statfs()) lustre-MDT0000-mdc-ffff9410107bd800: age 5798, max_age 5937 00000100:00100000:2.0:1767323388.479118:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811328:192.168.204.130@tcp:41:rm.0 00000100:00100000:2.0:1767323388.479200:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.503935:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811328:192.168.204.130@tcp:41:rm.0 00800000:00000004:2.0:1767323388.503985:0:127091:0:(obd_class.h:1109:obd_statfs()) lustre-MDT0000-mdc-ffff9410107bd800: update ffff941005b5e6d0 cache blocks 31223/35538 objects 49227/49768 00000080:00000004:2.0:1767323388.503995:0:127091:0:(obd_class.h:1109:obd_statfs()) lustre-clilmv-ffff9410107bd800: update ffff941005b5b520 cache blocks 31223/35538 objects 49227/49768 00000080:00000004:2.0:1767323388.504002:0:127091:0:(llite_lib.c:2629:ll_statfs_internal()) MDC blocks 31223/35538 objects 49227/49768 00000080:00200000:2.0:1767323388.504052:0:127091:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348) pos/size0/4096 32bit_api 0 00000080:00200000:2.0:1767323388.504110:0:127091:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:2.0:1767323388.504140:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.504182:0:127091:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000402:0x7f:0x0](ffff941004bd5348), flags=0 00000080:00200000:2.0:1767323388.504210:0:127091:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000402:0x7f:0x0](ffff941004bd5348), intent=getattr 00000002:00010000:2.0:1767323388.504243:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x0:0x0:0x0]) in obj [0x200000402:0x7f:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.504751:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.504762:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00010000:00010000:2.0:1767323388.504773:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:2.0:1767323388.504800:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811456:192.168.204.130@tcp:101:rm.0 00000100:00100000:2.0:1767323388.504947:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.514082:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811456:192.168.204.130@tcp:101:rm.0 00010000:00010000:2.0:1767323388.514130:0:127091:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.514159:0:127091:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x84:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.514168:0:127091:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.514183:0:127091:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.514196:0:127091:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.514211:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.514239:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.514246:0:127091:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.514269:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff941018138000 x1853171975811456/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/840 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.514282:0:127091:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 256 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767323388.514298:0:127091:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.514311:0:127091:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589935618/132 (0 0) 00000080:00200000:2.0:1767323388.514320:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x7f:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.514363:0:127091:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x84:0x0](ffff941004bd21c8) 00000080:00200000:2.0:1767323388.515231:0:127091:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x84:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:2.0:1767323388.515242:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x84:0x0](ffff941004bd21c8) for lock 0x720c8b170b556795 00000080:00010000:2.0:1767323388.515255:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x84:0x0](ffff941004bd21c8) 00000080:00010000:2.0:1767323388.515318:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556795 from it ffffb75488013df8 00010000:00010000:2.0:1767323388.515325:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.515336:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323388.515419:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348), inode mode 41ed mask 3 00000080:00200000:2.0:1767323388.515429:0:127091:0:(namei.c:2354:ll_unlink()) VFS Op:name=f4, dir=[0x200000402:0x7f:0x0](ffff941004bd5348) 00010000:00010000:2.0:1767323388.515890:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.515915:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.516185:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323388.516198:0:127091:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x84:0x0]: losing layout lock 00010000:00010000:2.0:1767323388.516235:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.516243:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.516250:0:127091:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1767323388.516253:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b556795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdb45 expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.517377:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b556780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdb06 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767323388.517424:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767323388.517441:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138000 x1853171975811712/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 488/752 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767323388.517512:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811712:192.168.204.130@tcp:36:rm.0 00000100:00100000:2.0:1767323388.517644:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.529295:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811712:192.168.204.130@tcp:36:rm.0 00000080:00200000:3.0:1767323388.529443:0:127091:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x84:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767323388.529459:0:127091:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1767323388.529485:0:127091:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1767323388.529511:0:127091:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x84:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767323388.529930:0:127091:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x84:0x0](ffff941004bd21c8) 00000080:00200000:3.0:1767323388.530116:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.530152:0:127091:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f2, dir=[0x200000402:0x7f:0x0](ffff941004bd5348), flags=0 00000080:00200000:3.0:1767323388.530157:0:127091:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f2, dir=[0x200000402:0x7f:0x0](ffff941004bd5348), intent=getattr 00000002:00010000:3.0:1767323388.530192:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f2,[0x0:0x0:0x0]) in obj [0x200000402:0x7f:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.530264:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.530275:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.530286:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:3.0:1767323388.530314:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811840:192.168.204.130@tcp:101:rm.0 00000100:00100000:3.0:1767323388.530552:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.535945:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975811840:192.168.204.130@tcp:101:rm.0 00010000:00010000:3.0:1767323388.535980:0:127091:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.536011:0:127091:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.536020:0:127091:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.536034:0:127091:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.536048:0:127091:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.536081:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.536090:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.536098:0:127091:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767323388.536111:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9410118e8000 x1853171975811840/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/840 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767323388.536125:0:127091:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 256 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767323388.536140:0:127091:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767323388.536152:0:127091:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589935618/130 (0 0) 00000080:00200000:3.0:1767323388.536160:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x7f:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767323388.536200:0:127091:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000402:0x82:0x0](ffff94102fa20908) 00000080:00200000:3.0:1767323388.536300:0:127091:0:(file.c:6809:ll_layout_conf()) [0x200000402:0x82:0x0]: layout version change: 4294967294 -> 1 00000080:00010000:3.0:1767323388.536307:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x82:0x0](ffff94102fa20908) for lock 0x720c8b170b55679c 00000080:00010000:3.0:1767323388.536320:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x82:0x0](ffff94102fa20908) 00000080:00010000:3.0:1767323388.536325:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55679c from it ffffb75488013df8 00010000:00010000:3.0:1767323388.536329:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767323388.536349:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767323388.536418:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348), inode mode 41ed mask 3 00000080:00200000:3.0:1767323388.536428:0:127091:0:(namei.c:2354:ll_unlink()) VFS Op:name=f2, dir=[0x200000402:0x7f:0x0](ffff941004bd5348) 00010000:00010000:3.0:1767323388.536473:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767323388.536490:0:127091:0:(vvp_object.c:114:vvp_conf_set()) [0x200000402:0x82:0x0]: losing layout lock 00010000:00010000:3.0:1767323388.536543:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 1/0,0 mode: --/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767323388.536551:0:127091:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767323388.536554:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b55679c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdb7d expref: -99 pid: 127091 timeout: 0 lvb_type: 3 00000020:00100000:3.0:1767323388.536585:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767323388.536593:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118e8000 x1853171975812096/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 488/752 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767323388.536620:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812096:192.168.204.130@tcp:36:rm.0 00000100:00100000:3.0:1767323388.537063:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.542091:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812096:192.168.204.130@tcp:36:rm.0 00000080:00200000:3.0:1767323388.542169:0:127091:0:(vvp_io.c:1854:vvp_io_init()) [0x200000402:0x82:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767323388.542187:0:127091:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767323388.542226:0:127091:0:(vvp_io.c:289:vvp_io_fini()) [0x200000402:0x82:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767323388.542236:0:127091:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x82:0x0](ffff94102fa20908) 00000080:00200008:3.0:1767323388.542353:0:127091:0:(file.c:424:ll_file_release()) START file a1:[0x200000402:0x7f:0x0](ffff941004bd5348), flags 704000 00010000:00010000:3.0:1767323388.542425:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.542472:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.542491:0:127091:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=a1, dir=[0x200000402:0x7e:0x0](ffff9410411d21c8), flags=0 00000080:00200000:3.0:1767323388.542496:0:127091:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=a1, dir=[0x200000402:0x7e:0x0](ffff9410411d21c8), intent=getattr 00000002:00010000:3.0:1767323388.542811:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: a1,[0x0:0x0:0x0]) in obj [0x200000402:0x7e:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.542886:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.542894:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.542905:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:3.0:1767323388.542930:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ead80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812224:192.168.204.130@tcp:101:rm.0 00000100:00100000:3.0:1767323388.543082:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.546659:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ead80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812224:192.168.204.130@tcp:101:rm.0 00010000:00010000:3.0:1767323388.546690:0:127091:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 4/1,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.546793:0:127091:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.546803:0:127091:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.546815:0:127091:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.546845:0:127091:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.546859:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.546893:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.546902:0:127091:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767323388.546915:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9410118ead80 x1853171975812224/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767323388.546930:0:127091:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.546942:0:127091:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589935618/127 (0 0) 00000080:00200000:3.0:1767323388.546950:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000402:0x7e:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767323388.546976:0:127091:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7f:0x0], updating i_size 4096 00000080:00200000:3.0:1767323388.546980:0:127091:0:(namei.c:151:ll_iget()) got inode: [0x200000402:0x7f:0x0](ffff941004bd5348): rc = 0 00000080:00010000:3.0:1767323388.546987:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) for lock 0x720c8b170b5567a3 00000080:00010000:3.0:1767323388.547002:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7f:0x0](ffff941004bd5348) 00000080:00010000:3.0:1767323388.547006:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567a3 from it ffffb75488013e00 00010000:00010000:3.0:1767323388.547009:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.547029:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.547074:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8), inode mode 41ed mask 3 00000080:00200000:3.0:1767323388.547083:0:127091:0:(namei.c:2264:ll_rmdir()) VFS Op:name=a1, dir=[0x200000402:0x7e:0x0](ffff9410411d21c8) 00010000:00010000:3.0:1767323388.547119:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.547139:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.547162:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.547172:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767323388.547221:0:127091:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff94101813b480 x1853171975811200/t8589934602(8589934602) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767323388.547234:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767323388.547241:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118ead80 x1853171975812480/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767323388.547266:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ead80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812480:192.168.204.130@tcp:35:rm.0 00000100:00100000:3.0:1767323388.547606:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.550816:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ead80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812480:192.168.204.130@tcp:35:rm.0 00000002:00100000:3.0:1767323388.550876:0:127091:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff94101813b480 x1853171975811200/t8589934602(8589934602) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 648/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1767323388.550990:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.551001:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 1/0,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.551009:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.551015:0:127091:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:3.0:1767323388.551019:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5567a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdbb5 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.551032:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55678e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdb22 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.551047:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b55676b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdac7 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1767323388.551065:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1767323388.551072:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118ead80 x1853171975812736/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 496/752 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1767323388.551098:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ead80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812736:192.168.204.130@tcp:36:rm.0 00000100:00100000:3.0:1767323388.551253:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.555370:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ead80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812736:192.168.204.130@tcp:36:rm.0 00000080:00200000:3.0:1767323388.555460:0:127091:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x7f:0x0](ffff941004bd5348) 00000080:00200008:3.0:1767323388.555674:0:127091:0:(file.c:424:ll_file_release()) START file d18d.sanity-lfsck:[0x200000402:0x7e:0x0](ffff9410411d21c8), flags 704000 00010000:00010000:3.0:1767323388.555978:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.556033:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:3.0:1767323388.556055:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.556067:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.556076:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.556084:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323388.556091:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:3.0:1767323388.556096:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b55675d 00000080:00010000:3.0:1767323388.556104:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55675d from it ffffb75488013c10 00010000:00010000:3.0:1767323388.556109:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.556119:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.556138:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.556160:0:127091:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d18d.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), flags=0 00000080:00200000:3.0:1767323388.556165:0:127091:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d18d.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), intent=getattr 00000002:00010000:3.0:1767323388.556181:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d18d.sanity-lfsck,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.556235:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.556243:0:127091:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00010000:00010000:3.0:1767323388.556260:0:127091:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127091 initiator: MDT0 00000100:00100000:3.0:1767323388.556286:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8e00 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812864:192.168.204.130@tcp:101:rm.0 00000100:00100000:3.0:1767323388.556429:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.560361:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8e00 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975812864:192.168.204.130@tcp:101:rm.0 00010000:00010000:2.0:1767323388.560657:0:127091:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.560680:0:127091:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.560688:0:127091:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.560783:0:127091:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.560797:0:127091:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.560811:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.560819:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 5/2,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.560827:0:127091:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.560840:0:127091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9410118e8e00 x1853171975812864/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/688 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.561058:0:127091:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.561090:0:127091:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589935618/126 (0 0) 00000080:00200000:2.0:1767323388.561099:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.561133:0:127091:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000402:0x7e:0x0], updating i_size 4096 00000080:00200000:2.0:1767323388.561136:0:127091:0:(namei.c:151:ll_iget()) got inode: [0x200000402:0x7e:0x0](ffff9410411d21c8): rc = 0 00000080:00010000:2.0:1767323388.561144:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) for lock 0x720c8b170b5567aa 00000080:00010000:2.0:1767323388.561158:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x7e:0x0](ffff9410411d21c8) 00000080:00010000:2.0:1767323388.561162:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567aa from it ffffb75488013e00 00010000:00010000:2.0:1767323388.561165:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.561175:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.561216:0:127091:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.561239:0:127091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.561249:0:127091:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.561260:0:127091:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.561266:0:127091:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.561271:0:127091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.561274:0:127091:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b55675d 00000080:00010000:2.0:1767323388.561278:0:127091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55675d from it ffffb75488013d88 00010000:00010000:2.0:1767323388.561281:0:127091:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.561298:0:127091:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.561307:0:127091:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767323388.561316:0:127091:0:(namei.c:2264:ll_rmdir()) VFS Op:name=d18d.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8) 00010000:00010000:2.0:1767323388.561340:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.561801:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.561818:0:127091:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.561883:0:127091:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff94101813b800 x1853171975810176/t8589934599(8589934599) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767323388.561896:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767323388.561901:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138a80 x1853171975813120/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767323388.561926:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138a80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975813120:192.168.204.130@tcp:35:rm.0 00000100:00100000:2.0:1767323388.562086:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.565841:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138a80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975813120:192.168.204.130@tcp:35:rm.0 00000002:00100000:2.0:1767323388.565900:0:127091:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff94101813b800 x1853171975810176/t8589934599(8589934599) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1767323388.565998:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.566026:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.566033:0:127091:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.566038:0:127091:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1767323388.566042:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5567aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdbe6 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.566053:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b556779 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdae3 expref: -99 pid: 127091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.566067:0:127091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010a51200/0x720c8b170b55675d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fda49 expref: -99 pid: 125479 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767323388.566088:0:127091:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767323388.566096:0:127091:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138a80 x1853171975813376/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 512/752 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767323388.566123:0:127091:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138a80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975813376:192.168.204.130@tcp:36:rm.0 00000100:00100000:2.0:1767323388.566278:0:127091:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.574143:0:127091:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138a80 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127091:1853171975813376:192.168.204.130@tcp:36:rm.0 00000080:00200000:2.0:1767323388.574209:0:127091:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000402:0x7e:0x0](ffff9410411d21c8) 00000080:00200000:0.0:1767323388.583093:0:127098:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.583137:0:127098:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.583223:0:127098:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.583246:0:127098:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.583259:0:127098:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 127098 initiator: MDT0 00000100:00100000:0.0:1767323388.583293:0:127098:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127098:1853171975813504:192.168.204.130@tcp:101:lfs.0 00000100:00100000:0.0:1767323388.583858:0:127098:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530f00 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.588168:0:127098:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127098:1853171975813504:192.168.204.130@tcp:101:lfs.0 00010000:00010000:0.0:1767323388.588207:0:127098:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.588222:0:127098:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.588236:0:127098:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.588249:0:127098:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.588263:0:127098:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.588271:0:127098:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.588278:0:127098:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767323388.588317:0:127098:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff941011be6680 x1853171975813504/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/688 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767323388.588333:0:127098:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.588348:0:127098:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1767323388.588356:0:127098:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767323388.588504:0:127098:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767323388.588513:0:127098:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567b1 00000080:00010000:0.0:1767323388.588534:0:127098:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.588537:0:127098:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567b1 from it ffffb75488013b58 00010000:00010000:0.0:1767323388.588541:0:127098:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.588550:0:127098:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.588580:0:127098:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.588606:0:127098:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d18e.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), flags=13 00000080:00200000:0.0:1767323388.588612:0:127098:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d18e.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), intent=getattr 00000002:00010000:0.0:1767323388.588642:0:127098:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d18e.sanity-lfsck,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.588697:0:127098:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.588704:0:127098:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.589202:0:127098:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127098 initiator: MDT0 00000100:00100000:0.0:1767323388.589246:0:127098:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127098:1853171975813632:192.168.204.130@tcp:101:lfs.0 00000100:00100000:0.0:1767323388.589877:0:127098:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530f00 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.594047:0:127098:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127098:1853171975813632:192.168.204.130@tcp:101:lfs.0 00010000:00010000:0.0:1767323388.594078:0:127098:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594094:0:127098:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594101:0:127098:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594109:0:127098:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594118:0:127098:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594125:0:127098:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941010aef400 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:0.0:1767323388.594131:0:127098:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594138:0:127098:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594146:0:127098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594153:0:127098:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767323388.594161:0:127098:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127098 initiator: MDT0 00010000:00010000:0.0:1767323388.594192:0:127098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aef400/0x720c8b170b5567b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127098 initiator: MDT0 00000002:00100000:0.0:1767323388.594214:0:127098:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff941011be6680 x1853171975813632/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767323388.594231:0:127098:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1767323388.594270:0:127098:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.594286:0:127098:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767323388.594295:0:127098:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567b1 from it ffffb75488013940 00010000:00010000:0.0:1767323388.594299:0:127098:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.594307:0:127098:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.594690:0:127098:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.594720:0:127098:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.594729:0:127098:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.594737:0:127098:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.594744:0:127098:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.594750:0:127098:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.594759:0:127098:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567b1 00000080:00010000:0.0:1767323388.594765:0:127098:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567b1 from it ffffb75488013be8 00010000:00010000:0.0:1767323388.594769:0:127098:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.594776:0:127098:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.594785:0:127098:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.594794:0:127098:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=16392 00000080:00200008:0.0:1767323388.594823:0:127098:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1767323388.594829:0:127098:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.594836:0:127098:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.594842:0:127098:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.594850:0:127098:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.594857:0:127098:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.594871:0:127098:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.594874:0:127098:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567b1 00000080:00010000:0.0:1767323388.594878:0:127098:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567b1 from it ffffb75488013cb8 00010000:00010000:0.0:1767323388.594881:0:127098:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.594889:0:127098:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1767323388.595809:0:127098:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1767323388.595816:0:127098:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.595830:0:127098:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.595840:0:127098:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.595852:0:127098:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.595859:0:127098:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.595877:0:127098:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.595880:0:127098:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567b1 00000080:00010000:0.0:1767323388.595885:0:127098:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567b1 from it ffffb75488013cb8 00010000:00010000:0.0:1767323388.595889:0:127098:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.595898:0:127098:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.596064:0:127098:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.596072:0:127098:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.596080:0:127098:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.596088:0:127098:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.596095:0:127098:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.596105:0:127098:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.596108:0:127098:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567b1 00000080:00010000:0.0:1767323388.596112:0:127098:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567b1 from it ffffb75488013bb0 00010000:00010000:0.0:1767323388.596116:0:127098:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.596124:0:127098:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.596132:0:127098:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 44 00000080:00200008:0.0:1767323388.596141:0:127098:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), flags 300000 00000080:00200080:0.0:1767323388.596162:0:127098:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8) cmd=c03066f0 arg=7ffdd61bf4c0 00000080:00200000:0.0:1767323388.596177:0:127098:0:(dir.c:483:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8) name=d18e.sanity-lfsck stripe_offset=0 stripe_count=1, hash_type=0 00000100:00100000:0.0:1767323388.596248:0:127098:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127098:1853171975813760:192.168.204.130@tcp:700:lfs.0 00000100:00100000:0.0:1767323388.597979:0:127098:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530f00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.600051:0:127098:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127098:1853171975813760:192.168.204.130@tcp:700:lfs.0 00010000:00010000:2.0:1767323388.600110:0:127098:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.600227:0:127098:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.600236:0:127098:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767323388.600239:0:127098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5567b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdc09 expref: -99 pid: 127098 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1767323388.600269:0:127098:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767323388.600279:0:127098:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff94101813b800 x1853171975814016/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 568/704 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767323388.600309:0:127098:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b800 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127098:1853171975814016:192.168.204.130@tcp:36:lfs.0 00000100:00100000:2.0:1767323388.600501:0:127098:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.669038:0:127098:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b800 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127098:1853171975814016:192.168.204.130@tcp:36:lfs.0 00000080:00200000:2.0:1767323388.669104:0:127098:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248) 00000080:00200000:2.0:1767323388.669112:0:127098:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x1:0x0], updating i_size 4096 00000080:00200008:2.0:1767323388.669162:0:127098:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), flags 300000 00000080:00200000:2.0:1767323388.690146:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.690189:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.690267:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.690279:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.690291:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:2.0:1767323388.690321:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814144:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.690877:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.695186:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814144:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.695222:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.695237:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.695251:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.695264:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.695278:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.695287:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.695295:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.695307:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff94101813bb80 x1853171975814144/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/688 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.695322:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.695336:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767323388.695362:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767323388.695658:0:126943:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767323388.695668:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323388.695674:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.695677:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e7bbf8 00010000:00010000:2.0:1767323388.695681:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.695690:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.695884:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.695906:0:126943:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=.lustre, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), flags=27 00000080:00200000:2.0:1767323388.695911:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=.lustre, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), intent=0 00000002:00010000:2.0:1767323388.695937:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: .lustre,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1767323388.695987:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.695995:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.696004:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:2.0:1767323388.696028:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814272:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.696178:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.699981:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814272:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.700011:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700051:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 4/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700060:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 4/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700073:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 4/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700084:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 4/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700097:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 5/2,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700106:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 5/2,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700114:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 4/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.700127:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff94101813bb80 x1853171975814272/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.700143:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700154:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589934594/1 (0 0) 00000080:00200000:2.0:1767323388.700164:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.700205:0:126943:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000002:0x1:0x0](ffff941004bd1148) 00000080:00200000:2.0:1767323388.700216:0:126943:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000002:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767323388.700225:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000002:0x1:0x0](ffff941004bd1148) for lock 0x720c8b170b5567c6 00000080:00010000:2.0:1767323388.700239:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000002:0x1:0x0](ffff941004bd1148) 00000080:00010000:2.0:1767323388.700243:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567c6 from it ffffb75487e7bac8 00010000:00010000:2.0:1767323388.700247:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.700256:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.700297:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff941004bd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.700316:0:126943:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=lost+found, dir=[0x200000002:0x1:0x0](ffff941004bd1148), flags=27 00000080:00200000:2.0:1767323388.700321:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=lost+found, dir=[0x200000002:0x1:0x0](ffff941004bd1148), intent=0 00000100:00100000:2.0:1767323388.700659:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814400:192.168.204.130@tcp:900:bash.0 00000100:00100000:2.0:1767323388.700912:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.704354:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814400:192.168.204.130@tcp:900:bash.0 00000002:00010000:3.0:1767323388.704590:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: lost+found,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1767323388.704670:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:3.0:1767323388.704682:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:3.0:1767323388.704694:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:3.0:1767323388.704817:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9500 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814528:192.168.204.130@tcp:101:bash.0 00000100:00100000:3.0:1767323388.704987:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.708238:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9500 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814528:192.168.204.130@tcp:101:bash.0 00010000:00010000:3.0:1767323388.708270:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.708296:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 4/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.708304:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 4/1,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.708338:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 4/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.708350:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 4/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.708365:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 5/2,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.708373:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 5/2,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.708622:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 4/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767323388.708637:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff9410118e9500 x1853171975814528/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 584/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767323388.708652:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.708664:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589934594/3 (0 0) 00000080:00200000:3.0:1767323388.708671:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 16 on i1 [0x200000002:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767323388.708882:0:126943:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000002:0x3:0x0](ffff9410411d5348) 00000080:00200000:0.0:1767323388.708892:0:126943:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000002:0x3:0x0], updating i_size 4096 00000080:00010000:0.0:1767323388.708900:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000002:0x3:0x0](ffff9410411d5348) for lock 0x720c8b170b5567cd 00000080:00010000:0.0:1767323388.708915:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000002:0x3:0x0](ffff9410411d5348) 00000080:00010000:0.0:1767323388.708919:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567cd from it ffffb75487e7bac8 00010000:00010000:0.0:1767323388.708923:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.708932:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.708971:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff9410411d5348), inode mode 4140 mask 1 00000080:00200000:0.0:1767323388.708995:0:126943:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=MDT0000, dir=[0x200000002:0x3:0x0](ffff9410411d5348), file ffff94101007bc80, open_flags 18800, mode 0 opened 0 00000080:00200000:0.0:1767323388.714009:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=MDT0000, dir=[0x200000002:0x3:0x0](ffff9410411d5348), intent=open 00000002:00010000:0.0:1767323388.714052:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: MDT0000,[0x0:0x0:0x0]) in obj [0x200000002:0x3:0x0], intent: open flags 0304001 00010000:00010000:0.0:1767323388.714143:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.714154:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000020:00100000:0.0:1767323388.714169:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767323388.714184:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941011be4a80 x1853171975814784/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/131984 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767323388.714194:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:0.0:1767323388.714223:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4a80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814784:192.168.204.130@tcp:101:bash.0 00000100:00100000:0.0:1767323388.714720:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530600 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.718965:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4a80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814784:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.718993:0:126943:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719008:0:126943:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719016:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719023:0:126943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719031:0:126943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719058:0:126943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941010aee200 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323388.719064:0:126943:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719071:0:126943:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719078:0:126943:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719086:0:126943:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323388.719095:0:126943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719102:0:126943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b5567d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 126943 initiator: MDT0 00000002:00100000:2.0:1767323388.719126:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff941011be4a80 x1853171975814784/t8589934610(8589934610) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767323388.719140:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941011be4a80 x1853171975814784/t8589934610(8589934610) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.719155:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000002:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.719202:0:126943:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000403:0x1:0x0](ffff941004bd6c08) 00000080:00200000:2.0:1767323388.719212:0:126943:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767323388.719219:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x1:0x0](ffff941004bd6c08) for lock 0x0 00000080:00200008:2.0:1767323388.719250:0:126943:0:(file.c:1001:ll_file_open()) START file MDT0000:[0x200000403:0x1:0x0](ffff941004bd6c08), flags 304000 00000002:00100000:2.0:1767323388.719272:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941011be4a80 x1853171975814784/t8589934610(8589934610) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.719327:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x1:0x0](ffff941004bd6c08), inode mode 41c0 mask 44 00000080:00200008:2.0:1767323388.719362:0:126943:0:(file.c:6252:ll_getattr_dentry()) START file MDT0000:[0x200000403:0x1:0x0](ffff941004bd6c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767323388.719369:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000403:0x1:0x0](ffff941004bd6c08),name=MDT0000 00000002:00010000:2.0:1767323388.719668:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x1:0x0]) in obj [0x200000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.719834:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719843:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.719854:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:2.0:1767323388.719894:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814912:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.720049:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.723481:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975814912:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.723513:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 4/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.723625:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 4/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.723641:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.723655:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.723670:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.723798:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.723807:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.723821:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff941018139880 x1853171975814912/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.723836:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.723850:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589935619/1 (0 0) 00000080:00200000:2.0:1767323388.723857:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000403:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767323388.723893:0:126943:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767323388.723900:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x1:0x0](ffff941004bd6c08) for lock 0x720c8b170b5567db 00000080:00010000:2.0:1767323388.723906:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x1:0x0](ffff941004bd6c08) 00000080:00010000:2.0:1767323388.723909:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567db from it ffffb75487e7bcd8 00010000:00010000:2.0:1767323388.723913:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.723923:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.724092:0:126943:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0x1:0x0](ffff941004bd6c08) pos/size0/4096 32bit_api 0 00000002:00010000:2.0:1767323388.724121:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000403:0x1:0x0]) in obj [0x200000403:0x1:0x0], intent: readdir flags 0 00010000:00010000:2.0:1767323388.724131:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.724154:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767323388.725128:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975815040:192.168.204.130@tcp:37:bash.0 00000100:00100000:2.0:1767323388.725332:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.731715:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975815040:192.168.204.130@tcp:37:bash.0 00010000:00010000:2.0:1767323388.732371:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.732415:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.732478:0:126943:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x200000403:0x1:0x0](ffff941004bd6c08) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:2.0:1767323388.732499:0:126943:0:(file.c:424:ll_file_release()) START file MDT0000:[0x200000403:0x1:0x0](ffff941004bd6c08), flags 304000 00000002:00100000:2.0:1767323388.732570:0:126943:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941011be4a80 x1853171975814784/t8589934610(8589934610) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767323388.732580:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767323388.732584:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018139880 x1853171975815296/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767323388.732604:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975815296:192.168.204.130@tcp:35:bash.0 00000100:00100000:2.0:1767323388.732769:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.735184:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975815296:192.168.204.130@tcp:35:bash.0 00000002:00100000:2.0:1767323388.735226:0:126943:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941011be4a80 x1853171975814784/t8589934610(8589934610) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.741334:0:127101:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.741613:0:127101:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.741635:0:127101:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.741654:0:127101:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.741663:0:127101:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.741674:0:127101:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.741678:0:127101:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323388.741687:0:127101:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e8bb58 00010000:00010000:2.0:1767323388.741691:0:127101:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.741797:0:127101:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.741819:0:127101:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.741830:0:127101:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=24 00000080:00200000:2.0:1767323388.741837:0:127101:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff941004bd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.741841:0:127101:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lost+found, flags=24 00000080:00200000:2.0:1767323388.741844:0:127101:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff9410411d5348), inode mode 4140 mask 1 00000080:00200000:2.0:1767323388.741858:0:127101:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=MDT0000, dir=[0x200000002:0x3:0x0](ffff9410411d5348), flags=24 00000080:00200000:2.0:1767323388.741875:0:127101:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=MDT0000, dir=[0x200000002:0x3:0x0](ffff9410411d5348), intent=0 00000002:00010000:2.0:1767323388.741891:0:127101:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: MDT0000,[0x0:0x0:0x0]) in obj [0x200000002:0x3:0x0], intent: lookup flags 0 00010000:00010000:2.0:1767323388.741955:0:127101:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.741978:0:127101:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.741991:0:127101:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127101 initiator: MDT0 00000100:00100000:2.0:1767323388.742028:0:127101:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127101:1853171975815424:192.168.204.130@tcp:101:rm.0 00000100:00100000:2.0:1767323388.742218:0:127101:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.745592:0:127101:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127101:1853171975815424:192.168.204.130@tcp:101:rm.0 00010000:00010000:2.0:1767323388.745622:0:127101:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745642:0:127101:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745650:0:127101:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745663:0:127101:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745675:0:127101:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745689:0:127101:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745707:0:127101:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 5/2,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745738:0:127101:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.745750:0:127101:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff941018139880 x1853171975815424/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.745765:0:127101:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745777:0:127101:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745791:0:127101:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745799:0:127101:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745805:0:127101:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745812:0:127101:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745836:0:127101:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:2.0:1767323388.745844:0:127101:0:(namei.c:955:ll_intent_lock()) intent lock 16 on i1 [0x200000002:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.745878:0:127101:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000403:0x1:0x0], updating i_size 4096 00000080:00200000:2.0:1767323388.745881:0:127101:0:(namei.c:151:ll_iget()) got inode: [0x200000403:0x1:0x0](ffff941004bd6c08): rc = 0 00000080:00010000:2.0:1767323388.745888:0:127101:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000403:0x1:0x0](ffff941004bd6c08) for lock 0x720c8b170b5567db 00000080:00010000:2.0:1767323388.745908:0:127101:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000403:0x1:0x0](ffff941004bd6c08) 00000080:00010000:2.0:1767323388.745911:0:127101:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567db from it ffffb75487e8ba28 00010000:00010000:2.0:1767323388.745915:0:127101:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.745924:0:127101:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.745964:0:127101:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x1:0x0](ffff941004bd6c08), inode mode 41c0 mask 1 00000080:00200000:2.0:1767323388.745988:0:127101:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=*, dir=[0x200000403:0x1:0x0](ffff941004bd6c08), flags=8 00000080:00200000:2.0:1767323388.745993:0:127101:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=*, dir=[0x200000403:0x1:0x0](ffff941004bd6c08), intent=getattr 00000002:00010000:2.0:1767323388.746017:0:127101:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: *,[0x0:0x0:0x0]) in obj [0x200000403:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.746062:0:127101:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.746069:0:127101:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.746079:0:127101:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127101 initiator: MDT0 00000100:00100000:2.0:1767323388.746104:0:127101:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127101:1853171975815552:192.168.204.130@tcp:101:rm.0 00000100:00100000:2.0:1767323388.746216:0:127101:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00010000:00010000:0.0:1767323388.746290:0:125438:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767323388.746299:0:125438:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.746307:0:125438:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941006a32c00 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:0.0:1767323388.746311:0:125438:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.746319:0:125438:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.746328:0:125438:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.746359:0:125438:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.746422:0:125438:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.746428:0:125438:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767323388.746462:0:125438:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.746469:0:125438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32c00/0x720c8b170b5567e2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdcbf expref: -99 pid: 127101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.746483:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323388.746485:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323388.746487:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767323388.746547:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975815680:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767323388.754012:0:127101:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127101:1853171975815552:192.168.204.130@tcp:101:rm.0 00010000:00010000:2.0:1767323388.754043:0:127101:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754058:0:127101:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754084:0:127101:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754092:0:127101:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754101:0:127101:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754108:0:127101:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941006a32200 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323388.754114:0:127101:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754122:0:127101:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754129:0:127101:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 5/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754137:0:127101:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323388.754144:0:127101:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127101 initiator: MDT0 00010000:00010000:2.0:1767323388.754151:0:127101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b5567e9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127101 initiator: MDT0 00000002:00100000:2.0:1767323388.754176:0:127101:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff941018139880 x1853171975815552/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.754194:0:127101:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000403:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1767323388.754229:0:127101:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.754257:0:127101:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1767323388.754268:0:127101:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567db from it ffffb75487e8b940 00010000:00010000:2.0:1767323388.754272:0:127101:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.754280:0:127101:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.754575:0:127101:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.754595:0:127101:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.754606:0:127101:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.754615:0:127101:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.754622:0:127101:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.754628:0:127101:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.754632:0:127101:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323388.754637:0:127101:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e8bc10 00010000:00010000:2.0:1767323388.754640:0:127101:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.754648:0:127101:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.754669:0:127101:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.754678:0:127101:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=24 00000080:00200000:2.0:1767323388.754685:0:127101:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff941004bd1148), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.754688:0:127101:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lost+found, flags=24 00000080:00200000:2.0:1767323388.754692:0:127101:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff9410411d5348), inode mode 4140 mask 1 00000080:00200000:2.0:1767323388.754705:0:127101:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=MDT0000, flags=24 00000080:00200000:2.0:1767323388.754708:0:127101:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000403:0x1:0x0](ffff941004bd6c08), inode mode 41c0 mask 1 00000080:00200000:2.0:1767323388.754716:0:127101:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=*, flags=0 00000100:00100000:3.0:1767323388.762099:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975815680:192.168.204.130@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1767323388.765592:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.765634:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.765658:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.765676:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.765686:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.765710:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.765714:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323388.765725:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e7bbf8 00010000:00010000:0.0:1767323388.765730:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.765749:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.765770:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.765780:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=27 00000080:00200000:0.0:1767323388.765788:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff941004bd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.765792:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lost+found, flags=27 00000080:00200000:0.0:1767323388.765795:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff9410411d5348), inode mode 4140 mask 1 00000080:00200000:0.0:1767323388.765810:0:126943:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=MDT0001, dir=[0x200000002:0x3:0x0](ffff9410411d5348), file ffff9410106ad080, open_flags 18800, mode 0 opened 0 00000080:00200000:0.0:1767323388.765818:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=MDT0001, dir=[0x200000002:0x3:0x0](ffff9410411d5348), intent=open 00000002:00010000:0.0:1767323388.765837:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: MDT0001,[0x0:0x0:0x0]) in obj [0x200000002:0x3:0x0], intent: open flags 0304001 00010000:00010000:0.0:1767323388.765923:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.765932:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000020:00100000:0.0:1767323388.765947:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767323388.765963:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941011be6300 x1853171975815936/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/131984 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767323388.765974:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:0.0:1767323388.766000:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975815936:192.168.204.130@tcp:101:bash.0 00000100:00100000:0.0:1767323388.766256:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.770979:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975815936:192.168.204.130@tcp:101:bash.0 00010000:00010000:0.0:1767323388.771015:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.771063:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.771071:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.771085:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.771098:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.771115:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.771124:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.771132:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767323388.771146:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=b, status=0 req@ffff941011be6300 x1853171975815936/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767323388.771161:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.771173:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 9663677442/1 (0 0) 00000100:00100000:0.0:1767323388.771231:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816064:192.168.204.130@tcp:900:bash.0 00000100:00100000:0.0:1767323388.771348:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.774206:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816064:192.168.204.130@tcp:900:bash.0 00000002:00010000:0.0:1767323388.774267:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000002:0x3:0x0]) in obj [0x240000402:0x1:0x0], intent: open flags 0304001 00010000:00010000:0.0:1767323388.774339:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.774350:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000020:00100000:0.0:1767323388.774365:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1767323388.774418:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941011be4000 x1853171975816320/t0(0) o101->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1767323388.774429:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:0.0:1767323388.774453:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816320:192.168.204.130@tcp:101:bash.0 00000100:00100000:0.0:1767323388.774647:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.798248:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816320:192.168.204.130@tcp:101:bash.0 00010000:00010000:0.0:1767323388.798276:0:126943:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798291:0:126943:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798298:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798305:0:126943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798337:0:126943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 4/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798343:0:126943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941010aef800 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:0.0:1767323388.798348:0:126943:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 4/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798356:0:126943:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 4/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798364:0:126943:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 5/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798371:0:126943:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767323388.798378:0:126943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798432:0:126943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b5567f7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 126943 initiator: MDT0 00000002:00100000:0.0:1767323388.798468:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff941011be4000 x1853171975816320/t8589934593(8589934593) o101->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1767323388.798484:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941011be4000 x1853171975816320/t8589934593(8589934593) o101->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767323388.798568:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000002:0x3:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767323388.798608:0:126943:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9410411d6c08) 00000080:00200000:0.0:1767323388.798618:0:126943:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767323388.798627:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff9410411d6c08) for lock 0x720c8b170b5567f0 00000080:00010000:0.0:1767323388.798642:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x1:0x0](ffff9410411d6c08) 00000080:00200008:0.0:1767323388.798660:0:126943:0:(file.c:1001:ll_file_open()) START file MDT0001:[0x240000402:0x1:0x0](ffff9410411d6c08), flags 304000 00000002:00100000:0.0:1767323388.798695:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941011be4000 x1853171975816320/t8589934593(8589934593) o101->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1767323388.798740:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567f0 from it ffff941007ba2060 00010000:00010000:0.0:1767323388.798745:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.798756:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.798780:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9410411d6c08), inode mode 41c0 mask 44 00000080:00200008:0.0:1767323388.798812:0:126943:0:(file.c:6252:ll_getattr_dentry()) START file MDT0001:[0x240000402:0x1:0x0](ffff9410411d6c08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767323388.798819:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9410411d6c08),name=MDT0001 00000002:00010000:0.0:1767323388.798843:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x1:0x0]) in obj [0x200000002:0x3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.798917:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798924:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:0.0:1767323388.798934:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:0.0:1767323388.798957:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816448:192.168.204.130@tcp:101:bash.0 00000100:00100000:0.0:1767323388.799342:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.802425:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816448:192.168.204.130@tcp:101:bash.0 00010000:00010000:0.0:1767323388.802458:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 4/1,0 mode: --/CR res: [0x200000002:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802489:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802512:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 4/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802522:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802533:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802543:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802548:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 5/2,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802553:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767323388.802561:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff941011be6300 x1853171975816448/t0(0) o101->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767323388.802571:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802578:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941004d5c800 type 13 mode 4 res 9663677442/1 (0 0) 00000080:00200000:0.0:1767323388.802584:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000002:0x3:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1767323388.802611:0:126943:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x240000402:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1767323388.802618:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x240000402:0x1:0x0](ffff9410411d6c08) for lock 0x720c8b170b5567fe 00000080:00010000:0.0:1767323388.802624:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x240000402:0x1:0x0](ffff9410411d6c08) 00000080:00010000:0.0:1767323388.802632:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567fe from it ffffb75487e7bcd8 00010000:00010000:0.0:1767323388.802636:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802645:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.802748:0:126943:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9410411d6c08) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1767323388.802776:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x240000402:0x1:0x0]) in obj [0x240000402:0x1:0x0], intent: readdir flags 0 00010000:00010000:0.0:1767323388.802785:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.802797:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767323388.803782:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816576:192.168.204.130@tcp:37:bash.0 00000100:00100000:0.0:1767323388.803918:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.809468:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816576:192.168.204.130@tcp:37:bash.0 00010000:00010000:0.0:1767323388.810277:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.810295:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.810372:0:126943:0:(dir.c:354:ll_iterate()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9410411d6c08) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200008:0.0:1767323388.810617:0:126943:0:(file.c:424:ll_file_release()) START file MDT0001:[0x240000402:0x1:0x0](ffff9410411d6c08), flags 304000 00000002:00100000:0.0:1767323388.810728:0:126943:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941011be4000 x1853171975816320/t8589934593(8589934593) o101->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767323388.810769:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767323388.810776:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941011be6300 x1853171975816832/t0(0) o35->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/568 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767323388.810804:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816832:192.168.204.130@tcp:35:bash.0 00000100:00100000:0.0:1767323388.810987:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.812778:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975816832:192.168.204.130@tcp:35:bash.0 00000002:00100000:0.0:1767323388.812816:0:126943:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941011be4000 x1853171975816320/t8589934593(8589934593) o101->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767323388.817812:0:127103:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.817854:0:127103:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.817892:0:127103:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.817912:0:127103:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.817923:0:127103:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.817937:0:127103:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.817942:0:127103:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323388.817951:0:127103:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e33b58 00010000:00010000:0.0:1767323388.817956:0:127103:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.817965:0:127103:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.817998:0:127103:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.818006:0:127103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=24 00000080:00200000:0.0:1767323388.818013:0:127103:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff941004bd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.818017:0:127103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lost+found, flags=24 00000080:00200000:0.0:1767323388.818021:0:127103:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff9410411d5348), inode mode 4140 mask 1 00000080:00200000:0.0:1767323388.818025:0:127103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=MDT0001, flags=24 00000080:00200000:0.0:1767323388.818028:0:127103:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9410411d6c08), inode mode 41c0 mask 1 00000080:00200000:0.0:1767323388.818042:0:127103:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=*, dir=[0x240000402:0x1:0x0](ffff9410411d6c08), flags=8 00000080:00200000:0.0:1767323388.818048:0:127103:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=*, dir=[0x240000402:0x1:0x0](ffff9410411d6c08), intent=getattr 00000002:00010000:0.0:1767323388.818066:0:127103:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: *,[0x0:0x0:0x0]) in obj [0x240000402:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.818127:0:127103:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.818136:0:127103:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.818148:0:127103:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127103 initiator: MDT0 00000100:00100000:0.0:1767323388.818179:0:127103:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127103:1853171975816960:192.168.204.130@tcp:101:rm.0 00000100:00100000:0.0:1767323388.818315:0:127103:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.821498:0:127103:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127103:1853171975816960:192.168.204.130@tcp:101:rm.0 00010000:00010000:0.0:1767323388.821522:0:127103:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821537:0:127103:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821546:0:127103:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821575:0:127103:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821584:0:127103:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 4/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821591:0:127103:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941010aef800 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:0.0:1767323388.821596:0:127103:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 4/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821602:0:127103:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 4/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821607:0:127103:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 5/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821709:0:127103:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1767323388.821718:0:127103:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127103 initiator: MDT0 00010000:00010000:0.0:1767323388.821725:0:127103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aef800/0x720c8b170b556805 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127103 initiator: MDT0 00000002:00100000:0.0:1767323388.821747:0:127103:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff941011be6300 x1853171975816960/t0(0) o101->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767323388.821765:0:127103:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x240000402:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1767323388.821797:0:127103:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.821808:0:127103:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 2/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1767323388.821823:0:127103:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567fe from it ffffb75487e33940 00010000:00010000:0.0:1767323388.821827:0:127103:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.821833:0:127103:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.821950:0:127103:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.821969:0:127103:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.821977:0:127103:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.821984:0:127103:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.821988:0:127103:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.821992:0:127103:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.821995:0:127103:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323388.822000:0:127103:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e33c10 00010000:00010000:0.0:1767323388.822002:0:127103:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.822006:0:127103:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.822013:0:127103:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.822019:0:127103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=24 00000080:00200000:0.0:1767323388.822025:0:127103:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff941004bd1148), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.822034:0:127103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=lost+found, flags=24 00000080:00200000:0.0:1767323388.822038:0:127103:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000002:0x3:0x0](ffff9410411d5348), inode mode 4140 mask 1 00000080:00200000:0.0:1767323388.822042:0:127103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=MDT0001, flags=24 00000080:00200000:0.0:1767323388.822044:0:127103:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9410411d6c08), inode mode 41c0 mask 1 00000080:00200000:0.0:1767323388.822051:0:127103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=*, flags=0 00000080:00200000:0.0:1767323388.828416:0:127104:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323388.828451:0:127104:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323388.828472:0:127104:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.828489:0:127104:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.828495:0:127104:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323388.828504:0:127104:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323388.828507:0:127104:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323388.828514:0:127104:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e73be0 00010000:00010000:0.0:1767323388.828517:0:127104:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.828523:0:127104:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.828536:0:127104:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.828547:0:127104:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=d18e.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), flags=24 00000080:00200000:0.0:1767323388.828551:0:127104:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=d18e.sanity-lfsck, dir=[0x200000007:0x1:0x0](ffff9410411d63c8), intent=0 00000002:00010000:0.0:1767323388.828562:0:127104:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d18e.sanity-lfsck,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1767323388.828908:0:127104:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127104 initiator: MDT0 00010000:00010000:0.0:1767323388.828924:0:127104:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127104 initiator: MDT0 00010000:00010000:0.0:1767323388.828935:0:127104:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127104 initiator: MDT0 00000100:00100000:0.0:1767323388.828962:0:127104:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job mkdir:b504cb06-162c-4989-9f96-575f2ee3236b:127104:1853171975817088:192.168.204.130@tcp:101:mkdir.0 00000100:00100000:0.0:1767323388.829101:0:127104:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.832331:0:127104:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job mkdir:b504cb06-162c-4989-9f96-575f2ee3236b:127104:1853171975817088:192.168.204.130@tcp:101:mkdir.0 00010000:00010000:0.0:1767323388.832360:0:127104:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832424:0:127104:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832435:0:127104:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832449:0:127104:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832463:0:127104:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832475:0:127104:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832481:0:127104:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832501:0:127104:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1767323388.832510:0:127104:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff941011be6300 x1853171975817088/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 592/688 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1767323388.832524:0:127104:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832537:0:127104:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/1 (0 0) 00000080:00200000:0.0:1767323388.832545:0:127104:0:(namei.c:955:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1767323388.832582:0:127104:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x1:0x0], updating i_size 4096 00000080:00200000:0.0:1767323388.832585:0:127104:0:(namei.c:151:ll_iget()) got inode: [0x200000bd1:0x1:0x0](ffff941004bd3248): rc = 0 00000080:00010000:0.0:1767323388.832590:0:127104:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x1:0x0](ffff941004bd3248) for lock 0x720c8b170b55680c 00000080:00010000:0.0:1767323388.832603:0:127104:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x1:0x0](ffff941004bd3248) 00000080:00010000:0.0:1767323388.832606:0:127104:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55680c from it ffffb75487e73ab0 00010000:00010000:0.0:1767323388.832608:0:127104:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323388.832624:0:127104:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323388.832661:0:127104:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:0.0:1767323388.832686:0:127104:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=a1, dir=[0x200000bd1:0x1:0x0](ffff941004bd3248), flags=1536 00000080:00200000:0.0:1767323388.832689:0:127104:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 3 00000080:00200000:0.0:1767323388.832696:0:127104:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 3 00000080:00200000:0.0:1767323388.832702:0:127104:0:(namei.c:2175:do_mkdir()) VFS Op:name=a1, dir=[0x200000bd1:0x1:0x0](ffff941004bd3248) 00000020:00100000:0.0:1767323388.832784:0:127104:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767323388.832794:0:127104:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941011be6300 x1853171975817344/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 552/704 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767323388.832815:0:127104:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job mkdir:b504cb06-162c-4989-9f96-575f2ee3236b:127104:1853171975817344:192.168.204.130@tcp:36:mkdir.0 00000100:00100000:0.0:1767323388.832931:0:127104:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.835964:0:127104:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job mkdir:b504cb06-162c-4989-9f96-575f2ee3236b:127104:1853171975817344:192.168.204.130@tcp:36:mkdir.0 00000080:00200000:0.0:1767323388.836020:0:127104:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8) 00000080:00200000:0.0:1767323388.836026:0:127104:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x2:0x0], updating i_size 4096 00000080:00200000:3.0:1767323388.843304:0:127105:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:3.0:1767323388.843349:0:127105:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.843372:0:127105:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.843482:0:127105:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.843492:0:127105:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323388.843503:0:127105:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:3.0:1767323388.843507:0:127105:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:3.0:1767323388.843516:0:127105:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75480d9bbf8 00010000:00010000:3.0:1767323388.843521:0:127105:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.843530:0:127105:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.843549:0:127105:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.843557:0:127105:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:3.0:1767323388.843564:0:127105:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.843578:0:127105:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 3 00000080:00200000:3.0:1767323388.843583:0:127105:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=a1, dir=[0x200000bd1:0x1:0x0](ffff941004bd3248), file ffff9410029e8600, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1767323388.843591:0:127105:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=a1, dir=[0x200000bd1:0x1:0x0](ffff941004bd3248), intent=open|creat 00000002:00010000:3.0:1767323388.843699:0:127105:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: a1,[0x200000bd1:0x3:0x0]) in obj [0x200000bd1:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1767323388.843780:0:127105:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.843789:0:127105:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127105 initiator: MDT0 00000020:00100000:3.0:1767323388.843806:0:127105:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767323388.843821:0:127105:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118eb480 x1853171975817600/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/66448 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767323388.843839:0:127105:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127105 initiator: MDT0 00000100:00100000:3.0:1767323388.843878:0:127105:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eb480 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127105:1853171975817600:192.168.204.130@tcp:101:lfs.0 00000100:00100000:3.0:1767323388.844072:0:127105:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.848178:0:127105:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eb480 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127105:1853171975817600:192.168.204.130@tcp:101:lfs.0 00010000:00010000:3.0:1767323388.848209:0:127105:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848225:0:127105:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848232:0:127105:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848239:0:127105:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 3/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848248:0:127105:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 4/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848254:0:127105:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a2a00 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:3.0:1767323388.848260:0:127105:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 4/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848267:0:127105:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 4/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848275:0:127105:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 5/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848283:0:127105:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767323388.848309:0:127105:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 3/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848317:0:127105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556813 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127105 initiator: MDT0 00000002:00100000:3.0:1767323388.848340:0:127105:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=b, status=-21 req@ffff9410118eb480 x1853171975817600/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.848357:0:127105:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000bd1:0x1:0x0] suppgids 0 -1: rc -21 00000080:00200000:3.0:1767323388.848574:0:127105:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:3.0:1767323388.848601:0:127105:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.848699:0:127105:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.848806:0:127105:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.848814:0:127105:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323388.848821:0:127105:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:3.0:1767323388.848825:0:127105:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:3.0:1767323388.848832:0:127105:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75480d9bbf8 00010000:00010000:3.0:1767323388.848836:0:127105:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.848844:0:127105:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.848870:0:127105:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.848879:0:127105:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:3.0:1767323388.848885:0:127105:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.848905:0:127105:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=a1, dir=[0x200000bd1:0x1:0x0](ffff941004bd3248), file ffff9410029e9080, open_flags 1a100, mode 0 opened 0 00000080:00200000:3.0:1767323388.848912:0:127105:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=a1, dir=[0x200000bd1:0x1:0x0](ffff941004bd3248), intent=open 00000002:00010000:3.0:1767323388.848929:0:127105:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: a1,[0x0:0x0:0x0]) in obj [0x200000bd1:0x1:0x0], intent: open flags 0320401 00010000:00010000:3.0:1767323388.848986:0:127105:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.848994:0:127105:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127105 initiator: MDT0 00000020:00100000:3.0:1767323388.849012:0:127105:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767323388.849021:0:127105:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118eb480 x1853171975817856/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/131984 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767323388.849030:0:127105:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127105 initiator: MDT0 00000100:00100000:3.0:1767323388.849053:0:127105:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eb480 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127105:1853171975817856:192.168.204.130@tcp:101:lfs.0 00000100:00100000:3.0:1767323388.849302:0:127105:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.856006:0:127105:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eb480 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127105:1853171975817856:192.168.204.130@tcp:101:lfs.0 00010000:00010000:3.0:1767323388.856037:0:127105:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856053:0:127105:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856061:0:127105:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856069:0:127105:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856078:0:127105:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856104:0:127105:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a2600 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:3.0:1767323388.856110:0:127105:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856117:0:127105:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856125:0:127105:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856133:0:127105:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767323388.856141:0:127105:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127105 initiator: MDT0 00010000:00010000:3.0:1767323388.856148:0:127105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b55681a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127105 initiator: MDT0 00000002:00100000:3.0:1767323388.856170:0:127105:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff9410118eb480 x1853171975817856/t8589934613(8589934613) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767323388.856184:0:127105:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9410118eb480 x1853171975817856/t8589934613(8589934613) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.856199:0:127105:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000bd1:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767323388.856225:0:127105:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x2:0x0], updating i_size 4096 00000080:00200000:3.0:1767323388.856229:0:127105:0:(namei.c:151:ll_iget()) got inode: [0x200000bd1:0x2:0x0](ffff9410411d21c8): rc = 0 00000080:00010000:3.0:1767323388.856234:0:127105:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x2:0x0](ffff9410411d21c8) for lock 0x0 00000080:00200008:3.0:1767323388.856269:0:127105:0:(file.c:1001:ll_file_open()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 320400 00000002:00100000:3.0:1767323388.856292:0:127105:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9410118eb480 x1853171975817856/t8589934613(8589934613) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.856351:0:127105:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 44 00000080:00200080:2.0:1767323388.857070:0:127105:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8) cmd=4008669a arg=ce02e0 00000020:00100000:2.0:1767323388.857144:0:127105:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767323388.857154:0:127105:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018139880 x1853171975818112/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767323388.857180:0:127105:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127105:1853171975818112:192.168.204.130@tcp:36:lfs.0 00000100:00100000:2.0:1767323388.857299:0:127105:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.860137:0:127105:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139880 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127105:1853171975818112:192.168.204.130@tcp:36:lfs.0 00000080:00200008:2.0:1767323388.860211:0:127105:0:(file.c:424:ll_file_release()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 320000 00000002:00100000:2.0:1767323388.860287:0:127105:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9410118eb480 x1853171975817856/t8589934613(8589934613) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767323388.860301:0:127105:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767323388.860307:0:127105:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138e00 x1853171975818368/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767323388.860331:0:127105:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138e00 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127105:1853171975818368:192.168.204.130@tcp:35:lfs.0 00000100:00100000:2.0:1767323388.860795:0:127105:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.863007:0:127105:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138e00 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127105:1853171975818368:192.168.204.130@tcp:35:lfs.0 00000002:00100000:2.0:1767323388.863073:0:127105:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9410118eb480 x1853171975817856/t8589934613(8589934613) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.867263:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:3.0:1767323388.867300:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.867325:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.867343:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.867352:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323388.867362:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:3.0:1767323388.867368:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:3.0:1767323388.867410:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e7bbf8 00010000:00010000:3.0:1767323388.867415:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.867425:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.867445:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.867455:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:3.0:1767323388.867463:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.867475:0:126943:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=a1, dir=[0x200000bd1:0x1:0x0](ffff941004bd3248), flags=25 00000080:00200000:3.0:1767323388.867480:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=a1, dir=[0x200000bd1:0x1:0x0](ffff941004bd3248), intent=0 00000002:00010000:3.0:1767323388.867493:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: a1,[0x0:0x0:0x0]) in obj [0x200000bd1:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1767323388.867550:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:3.0:1767323388.867559:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:3.0:1767323388.867590:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:3.0:1767323388.867621:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8700 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975818496:192.168.204.130@tcp:101:bash.0 00000100:00100000:3.0:1767323388.867744:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.870796:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8700 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975818496:192.168.204.130@tcp:101:bash.0 00010000:00010000:3.0:1767323388.870831:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.870953:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.870963:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.870976:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.870989:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.871003:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.871012:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.871020:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767323388.871051:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff9410118e8700 x1853171975818496/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767323388.871067:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.871077:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/2 (0 0) 00000080:00200000:3.0:1767323388.871085:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 16 on i1 [0x200000bd1:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767323388.871113:0:126943:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x2:0x0], updating i_size 4096 00000080:00200000:3.0:1767323388.871117:0:126943:0:(namei.c:151:ll_iget()) got inode: [0x200000bd1:0x2:0x0](ffff9410411d21c8): rc = 0 00000080:00010000:3.0:1767323388.871124:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x2:0x0](ffff9410411d21c8) for lock 0x720c8b170b556821 00000080:00010000:3.0:1767323388.871142:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x2:0x0](ffff9410411d21c8) 00000080:00010000:3.0:1767323388.871145:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556821 from it ffffb75487e7bac8 00010000:00010000:3.0:1767323388.871149:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.871158:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.871201:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.871226:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 3 00000080:00200000:3.0:1767323388.871232:0:126943:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f1, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), file ffff9410029e8600, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1767323388.871241:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f1, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000002:00010000:3.0:1767323388.871273:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f1,[0x200000bd1:0x4:0x0]) in obj [0x200000bd1:0x2:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1767323388.871337:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:3.0:1767323388.871345:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000020:00100000:3.0:1767323388.871366:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767323388.871625:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118e8700 x1853171975818752/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/66448 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767323388.871636:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:3.0:1767323388.871662:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8700 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975818752:192.168.204.130@tcp:101:bash.0 00000100:00100000:3.0:1767323388.871903:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.877472:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8700 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975818752:192.168.204.130@tcp:101:bash.0 00010000:00010000:3.0:1767323388.877508:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.877551:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.877559:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.877573:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.877585:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.877601:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.877609:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.877637:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767323388.877651:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff9410118e8700 x1853171975818752/t8589934616(8589934616) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767323388.877667:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9410118e8700 x1853171975818752/t8589934616(8589934616) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767323388.877685:0:126943:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767323388.877700:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767323388.877712:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/4 (0 0) 00000080:00200000:3.0:1767323388.877719:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000bd1:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767323388.877736:0:126943:0:(namei.c:1569:ll_create_it()) VFS Op:name=f1, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000080:00200000:3.0:1767323388.877774:0:126943:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000bd1:0x4:0x0](ffff94102fa20908) 00000080:00200000:3.0:1767323388.877883:0:126943:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x4:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:3.0:1767323388.877889:0:126943:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000bd1:0x4:0x0](ffff94102fa20908) 00000080:00010000:3.0:1767323388.877893:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x4:0x0](ffff94102fa20908) for lock 0x720c8b170b556828 00000080:00010000:3.0:1767323388.877906:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x4:0x0](ffff94102fa20908) 00000080:00200008:3.0:1767323388.877926:0:126943:0:(file.c:1001:ll_file_open()) START file f1:[0x200000bd1:0x4:0x0](ffff94102fa20908), flags 101101 00000002:00100000:3.0:1767323388.877952:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9410118e8700 x1853171975818752/t8589934616(8589934616) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1767323388.877989:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556828 from it ffff9410398152a0 00010000:00010000:3.0:1767323388.877994:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767323388.878008:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1767323388.878034:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x4:0x0](ffff94102fa20908), inode mode 81a4 mask 40 00000080:00200008:3.0:1767323388.878145:0:126943:0:(file.c:2648:do_file_write_iter()) START file f1:[0x200000bd1:0x4:0x0], ppos: 0, count: 6 00000080:00200000:3.0:1767323388.878159:0:126943:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 6 bytes 00000080:00200000:3.0:1767323388.878167:0:126943:0:(file.c:2624:ll_do_tiny_write()) result: 0, original count 6 00000080:00200000:3.0:1767323388.878172:0:126943:0:(file.c:1994:ll_file_io_generic()) f1: write ppos: 0, bytes: 6 00000080:00200000:3.0:1767323388.878178:0:126943:0:(file.c:1759:ll_io_set_mirror()) f1: desiginated mirror: 0 00000020:00200000:3.0:1767323388.878187:0:126943:0:(cl_io.c:214:cl_io_rw_init()) header@000000002f98ef82[0x4, 1, [0x200000bd1:0x4:0x0] hash] 00000020:00200000:3.0:1767323388.878189:0:126943:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6) 0 0 00000080:00200000:3.0:1767323388.878195:0:126943:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x4:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:3.0:1767323388.878213:0:126943:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1767323388.878222:0:126943:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6) 6, 6 00020000:00200000:3.0:1767323388.878226:0:126943:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767323388.878247:0:126943:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1767323388.878265:0:126943:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1767323388.878271:0:126943:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff94103960aeb0, osc lock ffff9410081b9b50, flags 0x0 00000100:00080000:3.0:1767323388.878296:0:126943:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-ffff9410107bd800: connect to NID 192.168.204.130@tcp last attempt 5796 00000100:00080000:3.0:1767323388.878310:0:126943:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-ffff9410107bd800: import ffff941008d1e800 using connection 192.168.204.130@tcp/192.168.204.130@tcp 00000008:00100000:3.0:1767323388.878322:0:126943:0:(osc_request.c:3784:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 34668544 ocd_grant: 7950336, lost: 0. 00000100:00100000:3.0:1767323388.878346:0:126943:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9410118e9180 x1853171975818880/t0(0) o8->lustre-OST0000-osc-ffff9410107bd800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1767323388.878437:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323388.878446:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323388.878469:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00080000:3.0:1767323388.878489:0:126943:0:(client.c:1829:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9410118e9f80 x1853171975819008/t0(0) o101->lustre-OST0000-osc-ffff9410107bd800@192.168.204.130@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1767323388.878499:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 0 seconds 00000100:00100000:2.0:1767323388.878614:0:111000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b504cb06-162c-4989-9f96-575f2ee3236b:111000:1853171975818880:192.168.204.130@tcp:8:bash.0 00000100:00100000:2.0:1767323388.881242:0:111000:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9410107bd800: committing for last_committed 0 gen 2 00000100:00080000:2.0:1767323388.881264:0:111000:0:(import.c:1123:ptlrpc_connect_interpret()) lustre-OST0000-osc-ffff9410107bd800: connect to target with instance 2 00000100:00080000:2.0:1767323388.881275:0:111000:0:(import.c:951:ptlrpc_connect_set_flags()) lustre-OST0000-osc-ffff9410107bd800: Resetting ns_connect_flags to server flags: 0xa0425af2e3440038 00000080:00000004:2.0:1767323388.881291:0:111000:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:2.0:1767323388.881298:0:111000:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1767323388.881305:0:111000:0:(import.c:1204:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1767323388.881311:0:111000:0:(import.c:65:import_set_state_nolock()) ffff941008d1e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000080:00000004:2.0:1767323388.881320:0:111000:0:(lcommon_misc.c:94:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440038 -> 0xa0425af2e3440038 00000080:00080000:2.0:1767323388.881322:0:111000:0:(lcommon_misc.c:56:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1767323388.881336:0:111000:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000a2304eef): req@ffff9410118e9f80 x1853171975819008/t0(0) o101->lustre-OST0000-osc-ffff9410107bd800@192.168.204.130@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1767323388.881814:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.882942:0:111000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b504cb06-162c-4989-9f96-575f2ee3236b:111000:1853171975818880:192.168.204.130@tcp:8:bash.0 00000100:00100000:3.0:1767323388.884501:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9f80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819008:192.168.204.130@tcp:101:bash.0 00010000:00010000:3.0:1767323388.884595:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323388.884685:0:126943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323388.884795:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323388.884814:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767323388.884827:0:126943:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323388.884841:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323388.884888:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767323388.884927:0:126943:0:(vvp_io.c:1312:vvp_io_write_start()) f1: write [0, 6) append 0 append lockpos 0 00000080:00200000:3.0:1767323388.884953:0:126943:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 6 bytes 00000080:00200000:3.0:1767323388.885071:0:126943:0:(rw26.c:912:ll_write_end()) pos 0, len 6, copied 6 00000080:00200000:3.0:1767323388.885088:0:126943:0:(rw26.c:969:ll_write_end()) page@00000000809b49a5[3 000000001ef5b5a7 2 1 000000004fe22662] 00000080:00200000:3.0:1767323388.885092:0:126943:0:(rw26.c:969:ll_write_end()) vmpage @00000000343b94c1 17ffffc0001021 2:0 ffff941010a530d8 0 lru 00000080:00200000:3.0:1767323388.885100:0:126943:0:(rw26.c:969:ll_write_end()) osc-page@00000000b243c566 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 0000000049f958ed 00000000e85e5658 > 3< 0 0 > 4< 0 0 8 7950336 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1767323388.885103:0:126943:0:(rw26.c:969:ll_write_end()) end page@00000000809b49a5 00000080:00200000:3.0:1767323388.885104:0:126943:0:(rw26.c:969:ll_write_end()) queued page: 1. 00000080:00200000:3.0:1767323388.885110:0:126943:0:(vvp_io.c:1193:vvp_io_write_commit()) commit async pages: 1, from 0, to 6 prio 0 00000008:00010000:3.0:1767323388.885138:0:126943:0:(osc_cache.c:814:osc_extent_find()) ### extent: 00000000c1ae0a1b ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767323388.885162:0:126943:0:(vvp_io.c:1106:vvp_set_batch_dirty()) mapping ffff94102fa20ab8, count 1, dirtied 1 00000080:00200000:3.0:1767323388.885168:0:126943:0:(vvp_io.c:1216:vvp_io_write_commit()) Committed 1 pages 6 bytes, tot: 6 00000080:00200000:3.0:1767323388.885172:0:126943:0:(vvp_io.c:1390:vvp_io_write_start()) f1: write bytes 0, result: 6 00000020:00010000:3.0:1767323388.885192:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff941011929308 (ffff941018190ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1767323388.885196:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941011929308 (ffff941018190ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1767323388.885200:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff94103960aeb0 (ffff941018190b48/1) at cl_lock_cancel():142 00010000:00010000:3.0:1767323388.885205:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323388.885214:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00010000:3.0:1767323388.885230:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941011929308 (ffff941018190ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1767323388.885239:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff94103960aeb0 (ffff941018190ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1767323388.885248:0:126943:0:(vvp_io.c:518:vvp_io_advance()) advancing 6 bytes 00000080:00200000:3.0:1767323388.885255:0:126943:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1767323388.885265:0:126943:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x4:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767323388.885269:0:126943:0:(file.c:2142:ll_file_io_generic()) f1: 2 io complete with rc: 0, result: 6, restart: 0 00000080:00200000:3.0:1767323388.885277:0:126943:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x4:0x0] updating i_size 6 i_blocks 0 00000080:00200000:3.0:1767323388.885283:0:126943:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 6 00000080:00200008:3.0:1767323388.885328:0:126943:0:(file.c:424:ll_file_release()) START file f1:[0x200000bd1:0x4:0x0](ffff94102fa20908), flags 100001 00000002:00100000:3.0:1767323388.885502:0:126943:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9410118e8700 x1853171975818752/t8589934616(8589934616) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767323388.885577:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767323388.885584:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118e9f80 x1853171975819264/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767323388.885612:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9f80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819264:192.168.204.130@tcp:35:bash.0 00000100:00100000:3.0:1767323388.885885:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.888257:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9f80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819264:192.168.204.130@tcp:35:bash.0 00000002:00100000:3.0:1767323388.888303:0:126943:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9410118e8700 x1853171975818752/t8589934616(8589934616) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.888578:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:3.0:1767323388.888603:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.888625:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.888642:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.888652:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323388.888679:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:3.0:1767323388.888684:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:3.0:1767323388.888695:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e7bbf8 00010000:00010000:3.0:1767323388.888700:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.888710:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.888729:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.888737:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:3.0:1767323388.888743:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.888748:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=25 00000080:00200000:3.0:1767323388.888753:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.888768:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 3 00000080:00200000:3.0:1767323388.888772:0:126943:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f2, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), file ffff9410029e9e00, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1767323388.888781:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f2, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000002:00010000:3.0:1767323388.888805:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f2,[0x200000bd1:0x5:0x0]) in obj [0x200000bd1:0x2:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1767323388.888880:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:3.0:1767323388.888888:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000020:00100000:3.0:1767323388.888902:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1767323388.888910:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118ebb80 x1853171975819520/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/66448 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1767323388.888921:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:3.0:1767323388.888951:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ebb80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819520:192.168.204.130@tcp:101:bash.0 00000100:00100000:3.0:1767323388.889127:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.892204:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ebb80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819520:192.168.204.130@tcp:101:bash.0 00010000:00010000:3.0:1767323388.892232:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.892252:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.892258:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.892269:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.892277:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.892287:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.892292:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.892298:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1767323388.892310:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff9410118ebb80 x1853171975819520/t8589934618(8589934618) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767323388.892345:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9410118ebb80 x1853171975819520/t8589934618(8589934618) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1767323388.892363:0:126943:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00010000:3.0:1767323388.892538:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1767323388.892549:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/5 (0 0) 00000080:00200000:3.0:1767323388.892555:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000bd1:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1767323388.892569:0:126943:0:(namei.c:1569:ll_create_it()) VFS Op:name=f2, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000080:00200000:2.0:1767323388.892762:0:126943:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000bd1:0x5:0x0](ffff941004bd42c8) 00000080:00200000:2.0:1767323388.892874:0:126943:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x5:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1767323388.892880:0:126943:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) 00000080:00010000:2.0:1767323388.892884:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) for lock 0x720c8b170b556836 00000080:00010000:2.0:1767323388.892896:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) 00000080:00200008:2.0:1767323388.892915:0:126943:0:(file.c:1001:ll_file_open()) START file f2:[0x200000bd1:0x5:0x0](ffff941004bd42c8), flags 101101 00000002:00100000:2.0:1767323388.892941:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff9410118ebb80 x1853171975819520/t8589934618(8589934618) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1767323388.892977:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556836 from it ffff9410398152a0 00010000:00010000:2.0:1767323388.892981:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.892996:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323388.893022:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x5:0x0](ffff941004bd42c8), inode mode 81a4 mask 40 00000080:00200008:2.0:1767323388.893102:0:126943:0:(file.c:2648:do_file_write_iter()) START file f2:[0x200000bd1:0x5:0x0], ppos: 0, count: 4 00000080:00200000:2.0:1767323388.893116:0:126943:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 4 bytes 00000080:00200000:2.0:1767323388.893123:0:126943:0:(file.c:2624:ll_do_tiny_write()) result: 0, original count 4 00000080:00200000:2.0:1767323388.893127:0:126943:0:(file.c:1994:ll_file_io_generic()) f2: write ppos: 0, bytes: 4 00000080:00200000:2.0:1767323388.893132:0:126943:0:(file.c:1759:ll_io_set_mirror()) f2: desiginated mirror: 0 00000020:00200000:2.0:1767323388.893140:0:126943:0:(cl_io.c:214:cl_io_rw_init()) header@00000000a644a6af[0x4, 1, [0x200000bd1:0x5:0x0] hash] 00000020:00200000:2.0:1767323388.893143:0:126943:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4) 0 0 00000080:00200000:2.0:1767323388.893148:0:126943:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767323388.893162:0:126943:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767323388.893169:0:126943:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4) 4, 4 00020000:00200000:2.0:1767323388.893173:0:126943:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767323388.893217:0:126943:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1767323388.893230:0:126943:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767323388.893235:0:126943:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941010b6b030, osc lock ffff941006c68e40, flags 0x0 00010000:00010000:2.0:1767323388.893286:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.893292:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.893303:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767323388.893324:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138e00 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819648:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.893989:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.896063:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138e00 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819648:192.168.204.130@tcp:101:bash.0 00010000:00010000:0.0:1767323388.896094:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323388.896114:0:126943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323388.896132:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323388.896148:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767323388.896163:0:126943:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323388.896176:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323388.896207:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767323388.896242:0:126943:0:(vvp_io.c:1312:vvp_io_write_start()) f2: write [0, 4) append 0 append lockpos 0 00000080:00200000:0.0:1767323388.896266:0:126943:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 4 bytes 00000080:00200000:0.0:1767323388.896331:0:126943:0:(rw26.c:912:ll_write_end()) pos 0, len 4, copied 4 00000080:00200000:0.0:1767323388.896346:0:126943:0:(rw26.c:969:ll_write_end()) page@000000001d2b0dd2[3 0000000016582bef 2 1 00000000b9a9a9a0] 00000080:00200000:0.0:1767323388.896350:0:126943:0:(rw26.c:969:ll_write_end()) vmpage @000000001b9fe936 17ffffc0001001 3:0 ffff9410396cc798 0 lru 00000080:00200000:0.0:1767323388.896360:0:126943:0:(rw26.c:969:ll_write_end()) osc-page@0000000034ee231c 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 0000000049f958ed 00000000f8c0b32a > 3< 0 0 > 4< 0 0 8 7921664 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1767323388.896363:0:126943:0:(rw26.c:969:ll_write_end()) end page@000000001d2b0dd2 00000080:00200000:0.0:1767323388.896364:0:126943:0:(rw26.c:969:ll_write_end()) queued page: 1. 00000080:00200000:0.0:1767323388.896370:0:126943:0:(vvp_io.c:1193:vvp_io_write_commit()) commit async pages: 1, from 0, to 4 prio 0 00000008:00010000:0.0:1767323388.896639:0:126943:0:(osc_cache.c:814:osc_extent_find()) ### extent: 00000000d442526a ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000080:00200000:0.0:1767323388.896664:0:126943:0:(vvp_io.c:1106:vvp_set_batch_dirty()) mapping ffff941004bd4478, count 1, dirtied 1 00000080:00200000:0.0:1767323388.896670:0:126943:0:(vvp_io.c:1216:vvp_io_write_commit()) Committed 1 pages 4 bytes, tot: 4 00000080:00200000:0.0:1767323388.896674:0:126943:0:(vvp_io.c:1390:vvp_io_write_start()) f2: write bytes 0, result: 4 00000020:00010000:0.0:1767323388.896778:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9410118f9e48 (ffff941010be97e8/0) at cl_lock_release():245 00000020:00010000:0.0:1767323388.896783:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9410118f9e48 (ffff941010be97e8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767323388.896787:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941010b6b030 (ffff941010be9248/1) at cl_lock_cancel():142 00010000:00010000:0.0:1767323388.896792:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323388.896802:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00010000:0.0:1767323388.896818:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9410118f9e48 (ffff941010be97e8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767323388.896827:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941010b6b030 (ffff941010be97e8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767323388.896836:0:126943:0:(vvp_io.c:518:vvp_io_advance()) advancing 4 bytes 00000080:00200000:0.0:1767323388.896845:0:126943:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1767323388.896854:0:126943:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767323388.896871:0:126943:0:(file.c:2142:ll_file_io_generic()) f2: 2 io complete with rc: 0, result: 4, restart: 0 00000080:00200000:0.0:1767323388.896881:0:126943:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x5:0x0] updating i_size 4 i_blocks 0 00000080:00200000:0.0:1767323388.896887:0:126943:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4 00000080:00200008:0.0:1767323388.896931:0:126943:0:(file.c:424:ll_file_release()) START file f2:[0x200000bd1:0x5:0x0](ffff941004bd42c8), flags 100001 00000002:00100000:0.0:1767323388.897011:0:126943:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff9410118ebb80 x1853171975819520/t8589934618(8589934618) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1767323388.897024:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1767323388.897029:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941011be4000 x1853171975819904/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1767323388.897055:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819904:192.168.204.130@tcp:35:bash.0 00000100:00100000:0.0:1767323388.897221:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.899538:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975819904:192.168.204.130@tcp:35:bash.0 00000002:00100000:2.0:1767323388.899611:0:126943:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff9410118ebb80 x1853171975819520/t8589934618(8589934618) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.899823:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.899849:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.899878:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.899895:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.899905:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.899913:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.899918:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323388.899927:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e7bbf8 00010000:00010000:2.0:1767323388.899931:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.899941:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.899960:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.899966:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:2.0:1767323388.899971:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.899974:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=25 00000080:00200000:2.0:1767323388.899980:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.899992:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767323388.899996:0:126943:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f3, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), file ffff9410116ef380, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1767323388.900003:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f3, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000002:00010000:2.0:1767323388.900034:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f3,[0x200000bd1:0x6:0x0]) in obj [0x200000bd1:0x2:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1767323388.900101:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.900109:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000020:00100000:2.0:1767323388.900122:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767323388.900129:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018139c00 x1853171975820160/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/66448 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767323388.900139:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:2.0:1767323388.900163:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139c00 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975820160:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.900326:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b000 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.904306:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139c00 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975820160:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.904342:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.904378:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.904417:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.904429:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.904438:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.904465:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.904471:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.904476:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.904484:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=37, status=0 req@ffff941018139c00 x1853171975820160/t8589934620(8589934620) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767323388.904494:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941018139c00 x1853171975820160/t8589934620(8589934620) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.904505:0:126943:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767323388.904515:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.904524:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/6 (0 0) 00000080:00200000:2.0:1767323388.904530:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000bd1:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.904542:0:126943:0:(namei.c:1569:ll_create_it()) VFS Op:name=f3, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000080:00200000:2.0:1767323388.904570:0:126943:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000bd1:0x6:0x0](ffff941004bd3a88) 00000080:00200000:2.0:1767323388.904710:0:126943:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x6:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:2.0:1767323388.904716:0:126943:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000bd1:0x6:0x0](ffff941004bd3a88) 00000080:00010000:2.0:1767323388.904720:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x6:0x0](ffff941004bd3a88) for lock 0x720c8b170b556844 00000080:00010000:2.0:1767323388.904731:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x6:0x0](ffff941004bd3a88) 00000080:00200008:2.0:1767323388.904756:0:126943:0:(file.c:1001:ll_file_open()) START file f3:[0x200000bd1:0x6:0x0](ffff941004bd3a88), flags 101101 00000002:00100000:2.0:1767323388.904781:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941018139c00 x1853171975820160/t8589934620(8589934620) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1767323388.904811:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556844 from it ffff941011abb300 00010000:00010000:2.0:1767323388.904815:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.904822:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323388.904843:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x6:0x0](ffff941004bd3a88), inode mode 81a4 mask 40 00000080:00200008:2.0:1767323388.904926:0:126943:0:(file.c:2648:do_file_write_iter()) START file f3:[0x200000bd1:0x6:0x0], ppos: 0, count: 6 00000080:00200000:2.0:1767323388.904940:0:126943:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 6 bytes 00000080:00200000:2.0:1767323388.904947:0:126943:0:(file.c:2624:ll_do_tiny_write()) result: 0, original count 6 00000080:00200000:2.0:1767323388.904951:0:126943:0:(file.c:1994:ll_file_io_generic()) f3: write ppos: 0, bytes: 6 00000080:00200000:2.0:1767323388.904957:0:126943:0:(file.c:1759:ll_io_set_mirror()) f3: desiginated mirror: 0 00000020:00200000:2.0:1767323388.904966:0:126943:0:(cl_io.c:214:cl_io_rw_init()) header@00000000653fb048[0x4, 1, [0x200000bd1:0x6:0x0] hash] 00000020:00200000:2.0:1767323388.904968:0:126943:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 6) 0 0 00000080:00200000:2.0:1767323388.904973:0:126943:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x6:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767323388.904990:0:126943:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767323388.904997:0:126943:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 6) 6, 6 00020000:00200000:2.0:1767323388.905002:0:126943:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767323388.905036:0:126943:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1767323388.905052:0:126943:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767323388.905057:0:126943:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941010b6bbb0, osc lock ffff941006c69430, flags 0x0 00010000:00010000:2.0:1767323388.905113:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.905122:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.905133:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767323388.905162:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139f80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975820288:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.905250:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b780 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.907569:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139f80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975820288:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.907599:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.907620:0:126943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.907638:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.907653:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323388.907668:0:126943:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.907682:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.907691:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767323388.907734:0:126943:0:(vvp_io.c:1312:vvp_io_write_start()) f3: write [0, 6) append 0 append lockpos 0 00000080:00200000:2.0:1767323388.907774:0:126943:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 6 bytes 00000080:00200000:2.0:1767323388.907830:0:126943:0:(rw26.c:912:ll_write_end()) pos 0, len 6, copied 6 00000080:00200000:2.0:1767323388.907844:0:126943:0:(rw26.c:969:ll_write_end()) page@000000001af389da[3 00000000e2107c6e 2 1 00000000fbee4f99] 00000080:00200000:2.0:1767323388.907849:0:126943:0:(rw26.c:969:ll_write_end()) vmpage @000000004a619582 17ffffc0001001 3:0 ffff941006d59ca8 0 lru 00000080:00200000:2.0:1767323388.907867:0:126943:0:(rw26.c:969:ll_write_end()) osc-page@0000000022dd19ae 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 0000000049f958ed 000000000b2d64b0 > 3< 0 0 > 4< 0 0 8 7892992 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1767323388.907870:0:126943:0:(rw26.c:969:ll_write_end()) end page@000000001af389da 00000080:00200000:2.0:1767323388.907871:0:126943:0:(rw26.c:969:ll_write_end()) queued page: 1. 00000080:00200000:2.0:1767323388.907878:0:126943:0:(vvp_io.c:1193:vvp_io_write_commit()) commit async pages: 1, from 0, to 6 prio 0 00000008:00010000:2.0:1767323388.907905:0:126943:0:(osc_cache.c:814:osc_extent_find()) ### extent: 00000000c33beecb ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767323388.907929:0:126943:0:(vvp_io.c:1106:vvp_set_batch_dirty()) mapping ffff941004bd3c38, count 1, dirtied 1 00000080:00200000:2.0:1767323388.907933:0:126943:0:(vvp_io.c:1216:vvp_io_write_commit()) Committed 1 pages 6 bytes, tot: 6 00000080:00200000:2.0:1767323388.907937:0:126943:0:(vvp_io.c:1390:vvp_io_write_start()) f3: write bytes 0, result: 6 00000020:00010000:2.0:1767323388.907957:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_release():245 00000020:00010000:2.0:1767323388.907961:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767323388.907965:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941010b6bbb0 (ffff941010be9758/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767323388.907970:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.907978:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767323388.907994:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_fini():72 00000020:00010000:2.0:1767323388.907997:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941010b6bbb0 (ffff941010be9518/1) at cl_lock_fini():72 00000080:00200000:2.0:1767323388.908006:0:126943:0:(vvp_io.c:518:vvp_io_advance()) advancing 6 bytes 00000080:00200000:2.0:1767323388.908014:0:126943:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767323388.908025:0:126943:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x6:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767323388.908030:0:126943:0:(file.c:2142:ll_file_io_generic()) f3: 2 io complete with rc: 0, result: 6, restart: 0 00000080:00200000:2.0:1767323388.908039:0:126943:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x6:0x0] updating i_size 6 i_blocks 0 00000080:00200000:2.0:1767323388.908050:0:126943:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 6 00000080:00200008:2.0:1767323388.908098:0:126943:0:(file.c:424:ll_file_release()) START file f3:[0x200000bd1:0x6:0x0](ffff941004bd3a88), flags 100001 00000002:00100000:2.0:1767323388.908177:0:126943:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941018139c00 x1853171975820160/t8589934620(8589934620) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767323388.908189:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767323388.908193:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018139f80 x1853171975820544/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767323388.908213:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139f80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975820544:192.168.204.130@tcp:35:bash.0 00000100:00100000:2.0:1767323388.908300:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b780 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.911001:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139f80 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975820544:192.168.204.130@tcp:35:bash.0 00000002:00100000:2.0:1767323388.911045:0:126943:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941018139c00 x1853171975820160/t8589934620(8589934620) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/664 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.927233:0:127106:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:3.0:1767323388.927278:0:127106:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.927300:0:127106:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.927320:0:127106:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.927329:0:127106:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323388.927338:0:127106:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:3.0:1767323388.927343:0:127106:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:3.0:1767323388.927352:0:127106:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e8bb58 00010000:00010000:3.0:1767323388.927356:0:127106:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.927366:0:127106:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323388.927431:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.927440:0:127106:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:3.0:1767323388.927448:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.927451:0:127106:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:3.0:1767323388.927457:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:3.0:1767323388.927470:0:127106:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags=8 00000080:00200000:3.0:1767323388.927474:0:127106:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=getattr 00000002:00010000:3.0:1767323388.927489:0:127106:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x0:0x0:0x0]) in obj [0x200000bd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323388.929261:0:127106:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.929284:0:127106:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.929298:0:127106:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127106 initiator: MDT0 00000100:00100000:3.0:1767323388.929337:0:127106:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8a80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975820672:192.168.204.130@tcp:101:lfs.0 00000100:00100000:3.0:1767323388.929562:0:127106:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.934140:0:127106:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8a80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975820672:192.168.204.130@tcp:101:lfs.0 00010000:00010000:3.0:1767323388.934171:0:127106:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934186:0:127106:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934195:0:127106:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934224:0:127106:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934232:0:127106:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934239:0:127106:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a3a00 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:3.0:1767323388.934245:0:127106:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934252:0:127106:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934259:0:127106:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934267:0:127106:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767323388.934274:0:127106:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.934281:0:127106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b556852 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127106 initiator: MDT0 00000002:00100000:3.0:1767323388.934305:0:127106:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff9410118e8a80 x1853171975820672/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.934321:0:127106:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x2:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1767323388.934354:0:127106:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 30 res 8589937617/2 (0 0) 00000080:00200000:2.0:1767323388.934920:0:127106:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.934947:0:127106:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.934958:0:127106:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.934971:0:127106:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.934979:0:127106:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.934985:0:127106:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.934989:0:127106:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323388.934995:0:127106:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e8bbf8 00010000:00010000:2.0:1767323388.934999:0:127106:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.935022:0:127106:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.935040:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.935049:0:127106:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:2.0:1767323388.935055:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.935059:0:127106:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=25 00000080:00200000:2.0:1767323388.935064:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.935077:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767323388.935082:0:127106:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), file ffff9410116ef380, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1767323388.935091:0:127106:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000002:00010000:2.0:1767323388.935118:0:127106:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x200000bd1:0x7:0x0]) in obj [0x200000bd1:0x2:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1767323388.935184:0:127106:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127106 initiator: MDT0 00010000:00010000:2.0:1767323388.935192:0:127106:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127106 initiator: MDT0 00000020:00100000:2.0:1767323388.935205:0:127106:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767323388.935214:0:127106:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138700 x1853171975820928/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/66448 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767323388.935224:0:127106:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127106 initiator: MDT0 00000100:00100000:2.0:1767323388.935251:0:127106:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138700 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975820928:192.168.204.130@tcp:101:lfs.0 00000100:00100000:2.0:1767323388.935832:0:127106:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b780 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.939091:0:127106:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138700 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975820928:192.168.204.130@tcp:101:lfs.0 00010000:00010000:2.0:1767323388.939140:0:127106:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939163:0:127106:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939170:0:127106:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939181:0:127106:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939189:0:127106:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939200:0:127106:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939205:0:127106:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939211:0:127106:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.939219:0:127106:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff941018138700 x1853171975820928/t8589934622(8589934622) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767323388.939230:0:127106:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941018138700 x1853171975820928/t8589934622(8589934622) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.939250:0:127106:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939262:0:127106:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/7 (0 0) 00000080:00200000:2.0:1767323388.939269:0:127106:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000bd1:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.939287:0:127106:0:(namei.c:1569:ll_create_it()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000080:00200000:2.0:1767323388.939328:0:127106:0:(llite_lib.c:3217:ll_read_inode2()) VFS Op:inode=[0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000080:00200000:2.0:1767323388.939337:0:127106:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x7:0x0], updating i_size 0 00000080:00200000:2.0:1767323388.939455:0:127106:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x7:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1767323388.939461:0:127106:0:(namei.c:1535:ll_create_node()) setting l_ast_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000080:00010000:2.0:1767323388.939465:0:127106:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) for lock 0x720c8b170b556859 00000080:00010000:2.0:1767323388.939476:0:127106:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000080:00200008:2.0:1767323388.939494:0:127106:0:(file.c:1001:ll_file_open()) START file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8), flags 120501 00000002:00100000:2.0:1767323388.939587:0:127106:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941018138700 x1853171975820928/t8589934622(8589934622) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1767323388.939628:0:127106:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556859 from it ffff941011abbe40 00010000:00010000:2.0:1767323388.939633:0:127106:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.939642:0:127106:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.939673:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x7:0x0](ffff941004bd00c8), inode mode 81a4 mask 40 00000080:00200000:2.0:1767323388.939745:0:127106:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x7:0x0](ffff941004bd00c8), inode mode 81a4 mask 2 00000080:00200000:2.0:1767323388.939755:0:127106:0:(xattr.c:406:ll_xattr_set()) VFS Op:inode=[0x200000bd1:0x7:0x0](ffff941004bd00c8), xattr lov 00000002:00010000:2.0:1767323388.939774:0:127106:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x7:0x0]) in obj [0x200000bd1:0x2:0x0], intent: open flags 040000002 00010000:00010000:2.0:1767323388.939830:0:127106:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127106 initiator: MDT0 00010000:00010000:2.0:1767323388.939842:0:127106:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127106 initiator: MDT0 00000020:00100000:2.0:1767323388.939853:0:127106:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767323388.939869:0:127106:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138e00 x1853171975821184/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/131984 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767323388.939878:0:127106:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127106 initiator: MDT0 00000100:00100000:2.0:1767323388.939900:0:127106:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138e00 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975821184:192.168.204.130@tcp:101:lfs.0 00000100:00100000:2.0:1767323388.940137:0:127106:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b300 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.942723:0:110994:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.130@tcp (source: 12345-192.168.204.130@tcp) 00000100:00100000:3.0:1767323388.942812:0:125434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853172047275264 00000100:00100000:3.0:1767323388.942825:0:125434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853172047275264 00000100:00100000:3.0:1767323388.942906:0:125434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.130@tcp, seq: 1 00000100:00100000:3.0:1767323388.942917:0:125434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff941011be5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b504cb06-162c-4989-9f96-575f2ee3236b+5:270880:x1853172047275264:12345-192.168.204.130@tcp:104: 00010000:00010000:3.0:1767323388.942956:0:125434:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323388.943053:0:125434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767323388.943061:0:125434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff941011be5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b504cb06-162c-4989-9f96-575f2ee3236b+5:270880:x1853172047275264:12345-192.168.204.130@tcp:104: Request processed in 146us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1767323388.943069:0:125434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.130@tcp, seq: 1 00010000:00010000:2.0:1767323388.943289:0:125439:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767323388.943299:0:125439:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.943309:0:125439:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941006a33200 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323388.943315:0:125439:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.943324:0:125439:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.943332:0:125439:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.943363:0:125439:0:(vvp_object.c:114:vvp_conf_set()) [0x200000bd1:0x7:0x0]: losing layout lock 00010000:00010000:2.0:1767323388.943467:0:125439:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.943486:0:125439:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767323388.943528:0:125439:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.943535:0:125439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556859 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x6f7fea81d46fde5c expref: -99 pid: 127106 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.943557:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767323388.943559:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767323388.943561:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323388.943610:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767323388.943630:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975821312:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767323388.947457:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975821312:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1767323388.950134:0:127106:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138e00 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975821184:192.168.204.130@tcp:101:lfs.0 00010000:00010000:3.0:1767323388.950163:0:127106:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950179:0:127106:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950187:0:127106:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950194:0:127106:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950203:0:127106:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950211:0:127106:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941006a32600 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:3.0:1767323388.950216:0:127106:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950224:0:127106:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950232:0:127106:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950264:0:127106:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1767323388.950273:0:127106:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127106 initiator: MDT0 00010000:00010000:3.0:1767323388.950280:0:127106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32600/0x720c8b170b556860 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127106 initiator: MDT0 00000002:00100000:3.0:1767323388.950304:0:127106:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@ffff941018138e00 x1853171975821184/t8589934623(8589934623) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/848 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767323388.950319:0:127106:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941018138e00 x1853171975821184/t8589934623(8589934623) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/848 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323388.950340:0:127106:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000bd1:0x2:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1767323388.950765:0:127106:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1767323388.950777:0:127106:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767323388.950889:0:127106:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x7:0x0], updating i_size 0 00000002:00100000:3.0:1767323388.950915:0:127106:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941018138e00 x1853171975821184/t8589934623(8589934623) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 760/848 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1767323388.950965:0:127106:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941018138e00 x1853171975821184/t8589934623(8589934623) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 760/848 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767323388.950977:0:127106:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767323388.950982:0:127106:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118e8a80 x1853171975821568/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767323388.951009:0:127106:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8a80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975821568:192.168.204.130@tcp:35:lfs.0 00000100:00100000:3.0:1767323388.951165:0:127106:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.955092:0:127106:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8a80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975821568:192.168.204.130@tcp:35:lfs.0 00000002:00100000:3.0:1767323388.955162:0:127106:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941018138e00 x1853171975821184/t8589934623(8589934623) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 760/848 e 0 to 0 dl 1767323404 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1767323388.955240:0:127106:0:(file.c:424:ll_file_release()) START file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8), flags 100001 00000002:00100000:3.0:1767323388.955310:0:127106:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941018138700 x1853171975820928/t8589934622(8589934622) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767323388.955323:0:127106:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767323388.955329:0:127106:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118e9880 x1853171975821824/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767323388.955353:0:127106:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9880 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975821824:192.168.204.130@tcp:35:lfs.0 00000100:00100000:3.0:1767323388.955879:0:127106:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1767323388.958738:0:127106:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9880 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127106:1853171975821824:192.168.204.130@tcp:35:lfs.0 00000002:00100000:3.0:1767323388.958787:0:127106:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941018138700 x1853171975820928/t8589934622(8589934622) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 520/608 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323388.961043:0:126943:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323388.961082:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323388.961105:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.961124:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.961133:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323388.961143:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323388.961147:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323388.961156:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e7bbf8 00010000:00010000:2.0:1767323388.961161:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.961170:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323388.961189:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.961213:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:2.0:1767323388.961220:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.961225:0:126943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=25 00000080:00200000:2.0:1767323388.961231:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323388.961244:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 3 00000080:00200000:2.0:1767323388.961249:0:126943:0:(namei.c:1354:ll_atomic_open()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), file ffff9410116eef00, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1767323388.961259:0:126943:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=open|creat 00000002:00010000:2.0:1767323388.961284:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x200000bd1:0x8:0x0]) in obj [0x200000bd1:0x2:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1767323388.961354:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.961362:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000020:00100000:2.0:1767323388.961819:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1767323388.961835:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff94101813b480 x1853171975822080/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/66448 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1767323388.961846:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:2.0:1767323388.961885:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822080:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.962074:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.966066:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822080:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.966100:0:126943:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.966128:0:126943:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.966163:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 4/0,1 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.966177:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.966189:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 4/0,1 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.966204:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.966212:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 5/1,1 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.966220:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.966233:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=2b, status=0 req@ffff94101813b480 x1853171975822080/t8589934626(8589934626) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/848 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1767323388.966244:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff94101813b480 x1853171975822080/t8589934626(8589934626) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/848 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.966258:0:126943:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767323388.966276:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.966300:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/7 (0 0) 00000080:00200000:2.0:1767323388.966308:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 3 on i1 [0x200000bd1:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323388.966803:0:126943:0:(namei.c:151:ll_iget()) got inode: [0x200000bd1:0x7:0x0](ffff941004bd00c8): rc = 0 00000080:00200000:2.0:1767323388.966824:0:126943:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x7:0x0]: layout version change: 4294967294 -> 2 00000080:00010000:2.0:1767323388.966829:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) for lock 0x720c8b170b556867 00000080:00010000:2.0:1767323388.966842:0:126943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000080:00200008:2.0:1767323388.966873:0:126943:0:(file.c:1001:ll_file_open()) START file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8), flags 101101 00000002:00100000:2.0:1767323388.966903:0:126943:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff94101813b480 x1853171975822080/t8589934626(8589934626) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 760/848 e 0 to 0 dl 1767323404 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1767323388.966946:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556867 from it ffff941011abbe40 00010000:00010000:2.0:1767323388.966951:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.966961:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323388.966991:0:126943:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x7:0x0](ffff941004bd00c8), inode mode 81a4 mask 42 00000002:00010000:2.0:1767323388.967024:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000bd1:0x7:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1767323388.967074:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.967083:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.967094:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:2.0:1767323388.967119:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813a300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822208:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.967343:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.971583:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813a300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822208:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.971619:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.971640:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.971652:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323388.971670:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff94101813a300 x1853171975822208/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 568/1328 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.971682:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.971773:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/7 (0 0) 00000080:00200000:2.0:1767323388.971781:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000bd1:0x7:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1767323388.971811:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) for lock 0x720c8b170b55686e 00000080:00010000:2.0:1767323388.971819:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55686e from it ffffb75487e7ba48 00010000:00010000:2.0:1767323388.971823:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323388.971830:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767323388.971881:0:126943:0:(llite_lib.c:2314:ll_setattr_raw()) START file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1767323388.000000000, mtime 1767323388.000000000, ctime 1767323388.000000000 00010000:00010000:2.0:1767323388.971943:0:126943:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323388.971965:0:126943:0:(vvp_object.c:114:vvp_conf_set()) [0x200000bd1:0x7:0x0]: losing layout lock 00010000:00010000:2.0:1767323388.972022:0:126943:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.972030:0:126943:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767323388.972033:0:126943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b556867 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fde94 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000020:00100000:2.0:1767323388.972055:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767323388.972063:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff94101813a300 x1853171975822464/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767323388.972094:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813a300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822464:192.168.204.130@tcp:36:bash.0 00000100:00100000:2.0:1767323388.972269:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.977361:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813a300 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822464:192.168.204.130@tcp:36:bash.0 00000080:00200000:2.0:1767323388.977477:0:126943:0:(file.c:1759:ll_io_set_mirror()) f4: desiginated mirror: 0 00000080:00200000:2.0:1767323388.977485:0:126943:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:2.0:1767323388.977514:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 31 res 8589937617/7 (0 0) 00000080:00010000:2.0:1767323388.977819:0:126943:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000002:00010000:2.0:1767323388.977833:0:126943:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x7:0x0]) in obj [0x200000bd1:0x7:0x0], intent: layout flags 0 00010000:00010000:2.0:1767323388.977910:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.977921:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00010000:00010000:2.0:1767323388.977961:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 126943 initiator: MDT0 00000100:00100000:2.0:1767323388.977987:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822592:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.978097:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.981276:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822592:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.981315:0:126943:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.981333:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1767323388.981350:0:126943:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff941018139500 x1853171975822592/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 376/584 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323388.981361:0:126943:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1767323388.981428:0:126943:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.981444:0:126943:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 16 res 8589937617/7 (0 0) 00000080:00200000:2.0:1767323388.981451:0:126943:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000bd1:0x7:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1767323388.981472:0:126943:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) for lock 0x720c8b170b556875 00000080:00010000:2.0:1767323388.981481:0:126943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556875 from it ffffb75487e7b8c8 00010000:00010000:2.0:1767323388.981485:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.981518:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.981551:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 2/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.981563:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 2/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767323388.981571:0:126943:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000bd1:0x7:0x0](000000008ad2028e) being reconfigured ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323388.981621:0:126943:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x7:0x0]: layout version change: 4294967294 -> 2 00010000:00010000:2.0:1767323388.981627:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323388.981635:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00020000:00200000:2.0:1767323388.981662:0:126943:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1767323388.981680:0:126943:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1767323388.981684:0:126943:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1767323388.981713:0:126943:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1767323388.981719:0:126943:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941010b6bcb0, osc lock ffff941006c69430, flags 0x80000000 00010000:00010000:2.0:1767323388.981776:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.981785:0:126943:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.981808:0:126943:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1767323388.981835:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822720:192.168.204.130@tcp:101:bash.0 00000100:00100000:2.0:1767323388.981950:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323388.985188:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975822720:192.168.204.130@tcp:101:bash.0 00010000:00010000:2.0:1767323388.985224:0:126943:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.985242:0:126943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.985253:0:126943:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.985270:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323388.985285:0:126943:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,2 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.985299:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 5/0,2 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.985307:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767323388.985665:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767323388.985686:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975822848:192.168.204.130@tcp:10:bash.0 00000100:00100000:3.0:1767323388.990956:0:111001:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9410107bd800: committing for last_committed 8589934601 gen 2 00000100:00100000:3.0:1767323388.991051:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975822848:192.168.204.130@tcp:10:bash.0 00000080:00200000:2.0:1767323388.991153:0:126943:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x7:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1767323388.991162:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_release():245 00000020:00010000:2.0:1767323388.991166:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767323388.991172:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941010b6bcb0 (ffff941010be9758/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767323388.991184:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.991199:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767323388.991218:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_fini():72 00000020:00010000:2.0:1767323388.991221:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941010b6bcb0 (ffff941010be9518/1) at cl_lock_fini():72 00000080:00200000:2.0:1767323388.991242:0:126943:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767323388.991259:0:126943:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8) current size 0, valid attrs a168, mode 0, uid 2, gid 0, new size 0, atime 1767323388.000000000, mtime 1767323388.000000000, ctime 1767323388.000000000, rc 0 00000080:00200008:2.0:1767323388.991479:0:126943:0:(file.c:2648:do_file_write_iter()) START file f4:[0x200000bd1:0x7:0x0], ppos: 0, count: 4 00000080:00200000:2.0:1767323388.991495:0:126943:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 4 bytes 00000080:00200000:2.0:1767323388.991503:0:126943:0:(file.c:2624:ll_do_tiny_write()) result: 0, original count 4 00000080:00200000:2.0:1767323388.991508:0:126943:0:(file.c:1994:ll_file_io_generic()) f4: write ppos: 0, bytes: 4 00000080:00200000:2.0:1767323388.991514:0:126943:0:(file.c:1759:ll_io_set_mirror()) f4: desiginated mirror: 0 00000020:00200000:2.0:1767323388.991579:0:126943:0:(cl_io.c:214:cl_io_rw_init()) header@000000003606649c[0x4, 1, [0x200000bd1:0x7:0x0] hash] 00000020:00200000:2.0:1767323388.991581:0:126943:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4) 0 0 00000080:00200000:2.0:1767323388.991586:0:126943:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/0, layout version 2 restore needed 0 00000080:00200000:2.0:1767323388.991602:0:126943:0:(file.c:2072:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1767323388.991611:0:126943:0:(lov_io.c:1052:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4) 4, 4 00020000:00200000:2.0:1767323388.991615:0:126943:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1767323388.991634:0:126943:0:(vvp_io.c:199:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1767323388.991652:0:126943:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1767323388.991657:0:126943:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941010b6bcb0, osc lock ffff941006c69430, flags 0x0 00010000:00010000:2.0:1767323388.991701:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.991717:0:126943:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.991731:0:126943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.991741:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 6/0,2 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.991748:0:126943:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767323388.991761:0:126943:0:(vvp_io.c:1312:vvp_io_write_start()) f4: write [0, 4) append 0 append lockpos 0 00000080:00200000:2.0:1767323388.991772:0:126943:0:(rw26.c:729:ll_write_begin()) Writing 0 of 0 to 4 bytes 00000080:00200000:2.0:1767323388.991821:0:126943:0:(rw26.c:912:ll_write_end()) pos 0, len 4, copied 4 00000080:00200000:2.0:1767323388.991830:0:126943:0:(rw26.c:969:ll_write_end()) page@000000006f9da117[3 00000000f97e6d4c 2 1 00000000fbee4f99] 00000080:00200000:2.0:1767323388.991834:0:126943:0:(rw26.c:969:ll_write_end()) vmpage @000000003b2af948 17ffffc0001001 3:0 ffff941006d59948 0 lru 00000080:00200000:2.0:1767323388.991843:0:126943:0:(rw26.c:969:ll_write_end()) osc-page@0000000049151630 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 0000000049f958ed 00000000a4d82e6a > 3< 0 0 > 4< 0 0 8 7864320 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1767323388.991846:0:126943:0:(rw26.c:969:ll_write_end()) end page@000000006f9da117 00000080:00200000:2.0:1767323388.991847:0:126943:0:(rw26.c:969:ll_write_end()) queued page: 1. 00000080:00200000:2.0:1767323388.991865:0:126943:0:(vvp_io.c:1193:vvp_io_write_commit()) commit async pages: 1, from 0, to 4 prio 0 00000008:00010000:2.0:1767323388.991889:0:126943:0:(osc_cache.c:814:osc_extent_find()) ### extent: 000000005ed449a8 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000080:00200000:2.0:1767323388.991914:0:126943:0:(vvp_io.c:1106:vvp_set_batch_dirty()) mapping ffff941004bd0278, count 1, dirtied 1 00000080:00200000:2.0:1767323388.991919:0:126943:0:(vvp_io.c:1216:vvp_io_write_commit()) Committed 1 pages 4 bytes, tot: 4 00000080:00200000:2.0:1767323388.991923:0:126943:0:(vvp_io.c:1390:vvp_io_write_start()) f4: write bytes 0, result: 4 00000020:00010000:2.0:1767323388.991951:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_release():245 00000020:00010000:2.0:1767323388.991954:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767323388.991957:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941010b6bcb0 (ffff941010be9758/1) at cl_lock_cancel():142 00010000:00010000:2.0:1767323388.991962:0:126943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323388.991971:0:126943:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00010000:2.0:1767323388.991982:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9410118f94e8 (ffff941010be9518/0) at cl_lock_fini():72 00000020:00010000:2.0:1767323388.991984:0:126943:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941010b6bcb0 (ffff941010be9518/1) at cl_lock_fini():72 00000080:00200000:2.0:1767323388.991990:0:126943:0:(vvp_io.c:518:vvp_io_advance()) advancing 4 bytes 00000080:00200000:2.0:1767323388.991994:0:126943:0:(file.c:2109:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1767323388.992000:0:126943:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767323388.992004:0:126943:0:(file.c:2142:ll_file_io_generic()) f4: 2 io complete with rc: 0, result: 4, restart: 0 00000080:00200000:2.0:1767323388.992011:0:126943:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x7:0x0] updating i_size 4 i_blocks 0 00000080:00200000:2.0:1767323388.992015:0:126943:0:(file.c:2228:ll_file_io_generic()) iot: 2, result: 4 00000080:00200008:2.0:1767323388.992036:0:126943:0:(file.c:424:ll_file_release()) START file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8), flags 100001 00000002:00100000:2.0:1767323388.992104:0:126943:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff94101813b480 x1853171975822080/t8589934626(8589934626) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 760/848 e 0 to 0 dl 1767323404 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1767323388.992118:0:126943:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1767323388.992123:0:126943:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138380 x1853171975823104/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1767323388.992148:0:126943:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138380 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975823104:192.168.204.130@tcp:35:bash.0 00000100:00100000:2.0:1767323388.992270:0:126943:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:0.0:1767323388.995546:0:126943:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138380 pname:cluuid:pid:xid:nid:opc:job bash:b504cb06-162c-4989-9f96-575f2ee3236b:126943:1853171975823104:192.168.204.130@tcp:35:bash.0 00000002:00100000:0.0:1767323388.995597:0:126943:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff94101813b480 x1853171975822080/t8589934626(8589934626) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 760/848 e 0 to 0 dl 1767323404 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1767323389.004122:0:127108:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323389.004159:0:127108:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323389.004182:0:127108:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323389.004201:0:127108:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.004220:0:127108:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323389.004230:0:127108:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323389.004235:0:127108:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323389.004244:0:127108:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ea3b58 00010000:00010000:0.0:1767323389.004248:0:127108:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323389.004258:0:127108:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.004276:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004285:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:0.0:1767323389.004292:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004297:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:0.0:1767323389.004303:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004306:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2, flags=8 00000080:00200008:0.0:1767323389.004313:0:127108:0:(file.c:6252:ll_getattr_dentry()) START file f2:[0x200000bd1:0x5:0x0](ffff941004bd42c8), request_mask 862, flags 0, foreign 0 00000080:00200000:0.0:1767323389.004318:0:127108:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x5:0x0](ffff941004bd42c8),name=f2 00000002:00010000:0.0:1767323389.004331:0:127108:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x5:0x0]) in obj [0x200000bd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323389.004339:0:127108:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323389.004347:0:127108:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767323389.004355:0:127108:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x2:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323389.004359:0:127108:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) 00000080:00010000:0.0:1767323389.004362:0:127108:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) for lock 0x720c8b170b556836 00000080:00010000:0.0:1767323389.004372:0:127108:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556836 from it ffffb75487ea3cb8 00010000:00010000:0.0:1767323389.004437:0:127108:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323389.004446:0:127108:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767323389.004470:0:127108:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:0.0:1767323389.004482:0:127108:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd1:0x5:0x0] 00000008:00010000:0.0:1767323389.004505:0:127108:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767323389.004508:0:127108:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941011b408b0, osc lock ffff941039dee390, flags 0x400001002 00010000:00010000:0.0:1767323389.004527:0:127108:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323389.004538:0:127108:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767323389.004550:0:127108:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1767323389.004555:0:127108:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323389.004562:0:127108:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767323389.004573:0:127108:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1767323389.004585:0:127108:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x5:0x0] updating i_size 4 i_blocks 0 00000020:00010000:0.0:1767323389.004591:0:127108:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff941039cc3b50 (ffff941010be97e8/0) at cl_lock_release():245 00000020:00010000:0.0:1767323389.004594:0:127108:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941039cc3b50 (ffff941010be97e8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767323389.004597:0:127108:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941011b408b0 (ffff941010be9248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767323389.004606:0:127108:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941039cc3b50 (ffff941010be97e8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767323389.004609:0:127108:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941011b408b0 (ffff941010be97e8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767323389.004621:0:127108:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x5:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767323389.004653:0:127108:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323389.004661:0:127108:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323389.004668:0:127108:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323389.004676:0:127108:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.004683:0:127108:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323389.004686:0:127108:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323389.004689:0:127108:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323389.004692:0:127108:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ea3bf8 00010000:00010000:0.0:1767323389.004695:0:127108:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323389.004702:0:127108:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.004711:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004715:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:0.0:1767323389.004720:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004722:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:0.0:1767323389.004725:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004729:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2, flags=8 00000080:00200000:0.0:1767323389.004751:0:127108:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323389.004759:0:127108:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323389.004772:0:127108:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323389.004780:0:127108:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.004787:0:127108:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323389.004791:0:127108:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323389.004793:0:127108:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323389.004797:0:127108:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ea3bf8 00010000:00010000:0.0:1767323389.004799:0:127108:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323389.004807:0:127108:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.004815:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004819:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:0.0:1767323389.004823:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004825:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=25 00000080:00200000:0.0:1767323389.004828:0:127108:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.004831:0:127108:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2, flags=9 00000080:00200000:2.0:1767323389.037248:0:127111:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323389.037290:0:127111:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323389.037316:0:127111:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.037341:0:127111:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.037351:0:127111:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323389.037359:0:127111:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323389.037364:0:127111:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323389.037662:0:127111:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ea3b58 00010000:00010000:2.0:1767323389.037669:0:127111:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.037680:0:127111:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.037786:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.037798:0:127111:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:2.0:1767323389.037807:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.037811:0:127111:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:2.0:1767323389.037817:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.037832:0:127111:0:(namei.c:1277:ll_lookup_nd()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags=8 00000080:00200000:2.0:1767323389.037837:0:127111:0:(namei.c:1020:ll_lookup_it()) VFS Op:name=f4, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8), intent=getattr 00000002:00010000:2.0:1767323389.037863:0:127111:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f4,[0x0:0x0:0x0]) in obj [0x200000bd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323389.037930:0:127111:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127111 initiator: MDT0 00010000:00010000:2.0:1767323389.037939:0:127111:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127111 initiator: MDT0 00010000:00010000:2.0:1767323389.037950:0:127111:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127111 initiator: MDT0 00000100:00100000:2.0:1767323389.038001:0:127111:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813aa00 pname:cluuid:pid:xid:nid:opc:job ls:b504cb06-162c-4989-9f96-575f2ee3236b:127111:1853171975823232:192.168.204.130@tcp:101:ls.0 00000100:00100000:2.0:1767323389.038187:0:127111:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323389.044326:0:127111:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813aa00 pname:cluuid:pid:xid:nid:opc:job ls:b504cb06-162c-4989-9f96-575f2ee3236b:127111:1853171975823232:192.168.204.130@tcp:101:ls.0 00010000:00010000:2.0:1767323389.044362:0:127111:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.044429:0:127111:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.044438:0:127111:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.044451:0:127111:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.044463:0:127111:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.044477:0:127111:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.044485:0:127111:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.044492:0:127111:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323389.044503:0:127111:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff94101813aa00 x1853171975823232/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 576/824 e 0 to 0 dl 1767323405 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323389.044545:0:127111:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 240 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 0 00000002:00010000:2.0:1767323389.044560:0:127111:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323389.044571:0:127111:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/7 (0 0) 00000080:00200000:2.0:1767323389.044579:0:127111:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x2:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1767323389.044637:0:127111:0:(namei.c:151:ll_iget()) got inode: [0x200000bd1:0x7:0x0](ffff941004bd00c8): rc = 0 00000080:00200000:2.0:1767323389.044654:0:127111:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x7:0x0]: layout version change: 2 -> 2 00000080:00010000:2.0:1767323389.044659:0:127111:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) for lock 0x720c8b170b556883 00000080:00010000:2.0:1767323389.044671:0:127111:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000080:00010000:2.0:1767323389.044674:0:127111:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556883 from it ffffb75487ea3b20 00010000:00010000:2.0:1767323389.044678:0:127111:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323389.044687:0:127111:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00000080:00200008:2.0:1767323389.044732:0:127111:0:(file.c:6252:ll_getattr_dentry()) START file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8), request_mask 862, flags 0, foreign 0 00000080:00200000:2.0:1767323389.044740:0:127111:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x7:0x0](ffff941004bd00c8),name=f4 00000002:00010000:2.0:1767323389.044767:0:127111:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x7:0x0]) in obj [0x200000bd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323389.044776:0:127111:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323389.044789:0:127111:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323389.044806:0:127111:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x2:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323389.044811:0:127111:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000080:00010000:2.0:1767323389.044815:0:127111:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) for lock 0x720c8b170b556883 00000080:00010000:2.0:1767323389.044820:0:127111:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556883 from it ffffb75487ea3cb8 00010000:00010000:2.0:1767323389.044823:0:127111:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323389.044831:0:127111:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323389.044852:0:127111:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00000001:00010000:2.0:1767323389.044874:0:127111:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd1:0x7:0x0] 00000008:00010000:2.0:1767323389.044898:0:127111:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767323389.044902:0:127111:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941010b6bcb0, osc lock ffff941006c69430, flags 0x400001002 00010000:00010000:2.0:1767323389.044922:0:127111:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.044931:0:127111:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767323389.044944:0:127111:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1767323389.044948:0:127111:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 6/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.044956:0:127111:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767323389.044979:0:127111:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1767323389.044991:0:127111:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x7:0x0] updating i_size 4 i_blocks 0 00000020:00010000:2.0:1767323389.044998:0:127111:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff941039cc1240 (ffff941010be9518/0) at cl_lock_release():245 00000020:00010000:2.0:1767323389.045001:0:127111:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941039cc1240 (ffff941010be9518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767323389.045005:0:127111:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941010b6bcb0 (ffff941010be9758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767323389.045009:0:127111:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941039cc1240 (ffff941010be9518/0) at cl_lock_fini():72 00000020:00010000:2.0:1767323389.045012:0:127111:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941010b6bcb0 (ffff941010be9518/1) at cl_lock_fini():72 00000080:00200000:2.0:1767323389.045023:0:127111:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767323389.045107:0:127111:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323389.045118:0:127111:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323389.045125:0:127111:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.045134:0:127111:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.045140:0:127111:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323389.045145:0:127111:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323389.045147:0:127111:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323389.045152:0:127111:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ea3bf8 00010000:00010000:2.0:1767323389.045155:0:127111:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.045162:0:127111:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.045170:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.045184:0:127111:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:2.0:1767323389.045190:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.045195:0:127111:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:2.0:1767323389.045199:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.045202:0:127111:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f4, flags=8 00000080:00200000:2.0:1767323389.045231:0:127111:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323389.045240:0:127111:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323389.045246:0:127111:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.045254:0:127111:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.045261:0:127111:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323389.045265:0:127111:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323389.045267:0:127111:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323389.045272:0:127111:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ea3bf8 00010000:00010000:2.0:1767323389.045275:0:127111:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.045282:0:127111:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.045291:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.045295:0:127111:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:2.0:1767323389.045299:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.045302:0:127111:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=25 00000080:00200000:2.0:1767323389.045305:0:127111:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.045308:0:127111:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f4, flags=9 00000080:00200000:2.0:1767323389.064611:0:127113:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323389.064662:0:127113:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323389.064684:0:127113:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.064705:0:127113:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.064715:0:127113:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323389.064724:0:127113:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323389.064728:0:127113:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323389.064737:0:127113:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487eabb98 00010000:00010000:2.0:1767323389.064742:0:127113:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.064751:0:127113:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.064772:0:127113:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.064780:0:127113:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:2.0:1767323389.064787:0:127113:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.064791:0:127113:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:2.0:1767323389.064797:0:127113:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.064801:0:127113:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f1, flags=8 00000080:00200000:1.0:1767323389.078755:0:127114:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.078796:0:127114:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.078817:0:127114:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.078836:0:127114:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.078845:0:127114:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.079887:0:127114:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.079898:0:127114:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.079912:0:127114:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e8bbf8 00010000:00010000:1.0:1767323389.079920:0:127114:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.079932:0:127114:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.079971:0:127114:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.079982:0:127114:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:1.0:1767323389.079991:0:127114:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.079996:0:127114:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=27 00000080:00200000:1.0:1767323389.080002:0:127114:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.080006:0:127114:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f1, flags=267 00000080:00200000:1.0:1767323389.080067:0:127114:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.080083:0:127114:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.080092:0:127114:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.080103:0:127114:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.080111:0:127114:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.080115:0:127114:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.080118:0:127114:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.080121:0:127114:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e8bbf8 00010000:00010000:1.0:1767323389.080124:0:127114:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.080132:0:127114:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.080140:0:127114:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.080144:0:127114:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:1.0:1767323389.080148:0:127114:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.080151:0:127114:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=267 00000080:00200000:1.0:1767323389.080161:0:127114:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767323389.080170:0:127114:0:(file.c:1001:ll_file_open()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 304000 00000002:00010000:1.0:1767323389.080190:0:127114:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x2:0x0]) in obj [0x200000bd1:0x1:0x0], intent: open flags 0100240304001 00010000:00010000:1.0:1767323389.080258:0:127114:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.080266:0:127114:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127114 initiator: MDT0 00000020:00100000:1.0:1767323389.080281:0:127114:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767323389.080296:0:127114:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941010e3ce00 x1853171975823488/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/131984 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767323389.080306:0:127114:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127114 initiator: MDT0 00000100:00100000:1.0:1767323389.080332:0:127114:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127114:1853171975823488:192.168.204.130@tcp:101:lfs.0 00000100:00100000:1.0:1767323389.081130:0:127114:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767323389.085009:0:127114:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127114:1853171975823488:192.168.204.130@tcp:101:lfs.0 00010000:00010000:1.0:1767323389.085038:0:127114:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085055:0:127114:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085063:0:127114:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085070:0:127114:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085079:0:127114:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085106:0:127114:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941018107c00 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:1.0:1767323389.085111:0:127114:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085119:0:127114:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085127:0:127114:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085134:0:127114:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1767323389.085143:0:127114:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127114 initiator: MDT0 00010000:00010000:1.0:1767323389.085149:0:127114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b55688a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 127114 initiator: MDT0 00000002:00100000:1.0:1767323389.085172:0:127114:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff941010e3ce00 x1853171975823488/t8589934630(8589934630) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767323389.085187:0:127114:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941010e3ce00 x1853171975823488/t8589934630(8589934630) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1767323389.085202:0:127114:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000bd1:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767323389.085227:0:127114:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x2:0x0], updating i_size 4096 00000002:00100000:1.0:1767323389.085253:0:127114:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941010e3ce00 x1853171975823488/t8589934630(8589934630) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767323389.085365:0:127114:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8) cmd=c0086915 arg=232e3d0 00000100:00100000:1.0:1767323389.085839:0:127114:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127114:1853171975823616:192.168.204.130@tcp:34:lfs.0 00000100:00100000:1.0:1767323389.086006:0:127114:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767323389.089844:0:127114:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127114:1853171975823616:192.168.204.130@tcp:34:lfs.0 00000080:00200008:1.0:1767323389.091027:0:127114:0:(file.c:424:ll_file_release()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 304000 00000002:00100000:1.0:1767323389.091134:0:127114:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941010e3ce00 x1853171975823488/t8589934630(8589934630) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1767323389.091150:0:127114:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1767323389.091156:0:127114:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941010e3fb80 x1853171975823872/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1767323389.091184:0:127114:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127114:1853171975823872:192.168.204.130@tcp:35:lfs.0 00000100:00100000:1.0:1767323389.091299:0:127114:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767323389.094765:0:127114:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127114:1853171975823872:192.168.204.130@tcp:35:lfs.0 00000002:00100000:3.0:1767323389.094820:0:127114:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941010e3ce00 x1853171975823488/t8589934630(8589934630) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1767323389.107612:0:127115:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323389.107658:0:127115:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323389.107682:0:127115:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.107797:0:127115:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.107823:0:127115:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323389.107833:0:127115:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323389.107838:0:127115:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323389.107848:0:127115:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e4bb98 00010000:00010000:2.0:1767323389.107864:0:127115:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.107874:0:127115:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.107894:0:127115:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.107905:0:127115:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:2.0:1767323389.107912:0:127115:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.107917:0:127115:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:2.0:1767323389.107923:0:127115:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.107927:0:127115:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2, flags=8 00000080:00200000:1.0:1767323389.121974:0:127116:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.122021:0:127116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.122045:0:127116:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.122064:0:127116:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.122074:0:127116:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.122084:0:127116:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.122089:0:127116:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.122097:0:127116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ebbbf8 00010000:00010000:1.0:1767323389.122102:0:127116:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.122112:0:127116:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.122144:0:127116:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.122154:0:127116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:1.0:1767323389.122161:0:127116:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.122166:0:127116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=27 00000080:00200000:1.0:1767323389.122172:0:127116:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.122177:0:127116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2, flags=267 00000080:00200000:1.0:1767323389.122211:0:127116:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.122220:0:127116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.122227:0:127116:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.122236:0:127116:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.122243:0:127116:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.122247:0:127116:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.122250:0:127116:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.122254:0:127116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ebbbf8 00010000:00010000:1.0:1767323389.122257:0:127116:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.122266:0:127116:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.122274:0:127116:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.122279:0:127116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:1.0:1767323389.122282:0:127116:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.122285:0:127116:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=267 00000080:00200000:1.0:1767323389.122296:0:127116:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767323389.122305:0:127116:0:(file.c:1001:ll_file_open()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 304000 00000002:00010000:1.0:1767323389.122326:0:127116:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x2:0x0]) in obj [0x200000bd1:0x1:0x0], intent: open flags 0104240304001 00010000:00010000:1.0:1767323389.122588:0:127116:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127116 initiator: MDT0 00010000:00010000:1.0:1767323389.122598:0:127116:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127116 initiator: MDT0 00000020:00100000:1.0:1767323389.122613:0:127116:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1767323389.122629:0:127116:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941010e3c000 x1853171975824128/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/131984 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1767323389.122640:0:127116:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127116 initiator: MDT0 00000100:00100000:1.0:1767323389.122668:0:127116:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c000 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127116:1853171975824128:192.168.204.130@tcp:101:lfs.0 00000100:00100000:1.0:1767323389.123079:0:127116:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088de780 going to sleep for 11 seconds 00000100:00100000:1.0:1767323389.127643:0:127116:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c000 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127116:1853171975824128:192.168.204.130@tcp:101:lfs.0 00010000:00010000:1.0:1767323389.127687:0:127116:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.127714:0:127116:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.127729:0:127116:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.127742:0:127116:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767323389.127785:0:127116:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff941010e3c000 x1853171975824128/t8589934632(8589934632) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1767323389.127800:0:127116:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941010e3c000 x1853171975824128/t8589934632(8589934632) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1767323389.127813:0:127116:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.127825:0:127116:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 16 res 8589937617/2 (0 0) 00000080:00200000:1.0:1767323389.127833:0:127116:0:(namei.c:955:ll_intent_lock()) intent lock 1 on i1 [0x200000bd1:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1767323389.127869:0:127116:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000bd1:0x2:0x0], updating i_size 4096 00000080:00010000:1.0:1767323389.127875:0:127116:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x2:0x0](ffff9410411d21c8) for lock 0x720c8b170b556891 00000080:00010000:1.0:1767323389.127889:0:127116:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556891 from it ffffb75487ebbbd0 00010000:00010000:1.0:1767323389.127893:0:127116:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.127903:0:127116:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1767323389.127938:0:127116:0:(mdc_request.c:810:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff941010e3c000 x1853171975824128/t8589934632(8589934632) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:1.0:1767323389.128051:0:127116:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8) cmd=c0086915 arg=156b3d0 00000100:00100000:1.0:1767323389.128140:0:127116:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127116:1853171975824256:192.168.204.130@tcp:34:lfs.0 00000100:00100000:1.0:1767323389.128250:0:127116:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088de780 going to sleep for 11 seconds 00010000:00010000:1.0:1767323389.129144:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323389.135498:0:127116:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127116:1853171975824256:192.168.204.130@tcp:34:lfs.0 00000080:00200008:1.0:1767323389.136122:0:127116:0:(file.c:424:ll_file_release()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 304000 00010000:00010000:1.0:1767323389.136166:0:127116:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.149136:0:127117:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.149179:0:127117:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.149202:0:127117:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.149222:0:127117:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.149232:0:127117:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.149241:0:127117:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.149245:0:127117:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.149255:0:127117:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487e8bb98 00010000:00010000:1.0:1767323389.149260:0:127117:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.149270:0:127117:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.149290:0:127117:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.149299:0:127117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:1.0:1767323389.149307:0:127117:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.149312:0:127117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:1.0:1767323389.149318:0:127117:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.149323:0:127117:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f3, flags=8 00000080:00200000:1.0:1767323389.161879:0:127118:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.161932:0:127118:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.161954:0:127118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.161974:0:127118:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.161983:0:127118:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.161992:0:127118:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.161997:0:127118:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.162006:0:127118:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ea3bf8 00010000:00010000:1.0:1767323389.162010:0:127118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.162020:0:127118:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.162040:0:127118:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.162049:0:127118:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:1.0:1767323389.162056:0:127118:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.162061:0:127118:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=27 00000080:00200000:1.0:1767323389.162066:0:127118:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.162070:0:127118:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f3, flags=267 00000080:00200000:1.0:1767323389.162103:0:127118:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.162112:0:127118:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.162119:0:127118:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.162127:0:127118:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.162144:0:127118:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.162149:0:127118:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.162151:0:127118:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.162156:0:127118:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ea3bf8 00010000:00010000:1.0:1767323389.162159:0:127118:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.162166:0:127118:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.162175:0:127118:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.162179:0:127118:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:1.0:1767323389.162183:0:127118:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.162187:0:127118:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=267 00000080:00200000:1.0:1767323389.162190:0:127118:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767323389.162198:0:127118:0:(file.c:1001:ll_file_open()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 304000 00000080:00200080:1.0:1767323389.162234:0:127118:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8) cmd=c0086915 arg=11a23d0 00000100:00100000:1.0:1767323389.162319:0:127118:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127118:1853171975824384:192.168.204.130@tcp:34:lfs.0 00000100:00100000:1.0:1767323389.162741:0:127118:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088de780 going to sleep for 11 seconds 00000100:00100000:1.0:1767323389.168946:0:127118:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127118:1853171975824384:192.168.204.130@tcp:34:lfs.0 00000080:00200008:1.0:1767323389.169202:0:127118:0:(file.c:424:ll_file_release()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 304000 00010000:00010000:1.0:1767323389.169240:0:127118:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.182744:0:127119:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323389.183161:0:127119:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323389.183181:0:127119:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323389.183196:0:127119:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.183212:0:127119:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323389.183220:0:127119:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323389.183223:0:127119:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323389.183230:0:127119:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ec3b98 00010000:00010000:0.0:1767323389.183234:0:127119:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323389.183241:0:127119:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323389.183255:0:127119:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.183262:0:127119:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:0.0:1767323389.183267:0:127119:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.183270:0:127119:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:0.0:1767323389.183275:0:127119:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323389.183278:0:127119:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f4, flags=8 00000080:00200000:1.0:1767323389.192231:0:127120:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.192268:0:127120:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.192293:0:127120:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.192308:0:127120:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.192315:0:127120:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.192324:0:127120:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.192327:0:127120:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.192335:0:127120:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ecbbf8 00010000:00010000:1.0:1767323389.192337:0:127120:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.192344:0:127120:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.192359:0:127120:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.192532:0:127120:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:1.0:1767323389.192541:0:127120:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.192547:0:127120:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=27 00000080:00200000:1.0:1767323389.192551:0:127120:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.192555:0:127120:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f4, flags=267 00000080:00200000:1.0:1767323389.192584:0:127120:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.192594:0:127120:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.192601:0:127120:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.192610:0:127120:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.192626:0:127120:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.192631:0:127120:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.192634:0:127120:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.192638:0:127120:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ecbbf8 00010000:00010000:1.0:1767323389.192642:0:127120:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.192648:0:127120:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.192657:0:127120:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.192661:0:127120:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=27 00000080:00200000:1.0:1767323389.192664:0:127120:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.192667:0:127120:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=267 00000080:00200000:1.0:1767323389.192671:0:127120:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 44 00000080:00200008:1.0:1767323389.192678:0:127120:0:(file.c:1001:ll_file_open()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 304000 00000080:00200080:1.0:1767323389.192794:0:127120:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8) cmd=c0086915 arg=13723d0 00000100:00100000:1.0:1767323389.193188:0:127120:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127120:1853171975824512:192.168.204.130@tcp:34:lfs.0 00000100:00100000:1.0:1767323389.193377:0:127120:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088de780 going to sleep for 11 seconds 00000100:00100000:1.0:1767323389.196245:0:127120:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job lfs:b504cb06-162c-4989-9f96-575f2ee3236b:127120:1853171975824512:192.168.204.130@tcp:34:lfs.0 00000080:00200008:1.0:1767323389.197129:0:127120:0:(file.c:424:ll_file_release()) START file a1:[0x200000bd1:0x2:0x0](ffff9410411d21c8), flags 304000 00010000:00010000:1.0:1767323389.197174:0:127120:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323389.209503:0:127122:0:(ldlm_resource.c:158:lru_size_store()) dropping all unused locks from namespace lustre-OST0000-osc-ffff9410107bd800 00010000:00010000:3.0:1767323389.209546:0:127122:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 4/4 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1767323389.209673:0:127123:0:(ldlm_resource.c:158:lru_size_store()) dropping all unused locks from namespace lustre-OST0001-osc-ffff9410107bd800 00010000:00010000:2.0:1767323389.210136:0:125439:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 4 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767323389.210147:0:125439:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800028480000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323389.210180:0:125439:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### extent: 000000005ed449a8 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800029480000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323389.210193:0:125439:0:(osc_cache.c:1103:osc_extent_make_ready()) ### extent: 000000005ed449a8 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800029480000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.210264:0:125439:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800029480000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00100000:2.0:1767323389.210363:0:125439:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff94101813aa00 - object 0x280000400:165 offset 0<>4 00000100:00100000:3.0:1767323389.210755:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975824640:192.168.204.130@tcp:4:bash.0 00000008:00010000:3.0:1767323389.214884:0:111003:0:(osc_cache.c:861:osc_extent_finish()) ### extent: 000000005ed449a8 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800029480000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767323389.214942:0:111003:0:(osc_cache.c:483:__osc_extent_remove()) ### extent: 000000005ed449a8 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800029480000000 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767323389.214975:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975824640:192.168.204.130@tcp:4:bash.0 00000080:00200000:2.0:1767323389.215123:0:125439:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767323389.215184:0:125439:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1767323389.215204:0:125439:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800028400000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323389.215221:0:125439:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### extent: 00000000d442526a ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323389.215233:0:125439:0:(osc_cache.c:1103:osc_extent_make_ready()) ### extent: 00000000d442526a ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.215277:0:125439:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00100000:2.0:1767323389.215356:0:125439:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff94101813b100 - object 0x280000400:163 offset 0<>4 00000100:00100000:0.0:1767323389.215628:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975824768:192.168.204.130@tcp:4:bash.0 00000008:00010000:0.0:1767323389.219365:0:111004:0:(osc_cache.c:861:osc_extent_finish()) ### extent: 00000000d442526a ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767323389.219586:0:111004:0:(osc_cache.c:483:__osc_extent_remove()) ### extent: 00000000d442526a ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767323389.219620:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975824768:192.168.204.130@tcp:4:bash.0 00000080:00200000:2.0:1767323389.219758:0:125439:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767323389.219821:0:125439:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1767323389.219845:0:125439:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800028400000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323389.219874:0:125439:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### extent: 00000000c33beecb ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323389.219886:0:125439:0:(osc_cache.c:1103:osc_extent_make_ready()) ### extent: 00000000c33beecb ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.219949:0:125439:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00100000:2.0:1767323389.220161:0:125439:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff941018139180 - object 0x280000400:164 offset 0<>6 00000100:00100000:3.0:1767323389.220232:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975824896:192.168.204.130@tcp:4:bash.0 00000008:00010000:3.0:1767323389.235640:0:111001:0:(osc_cache.c:861:osc_extent_finish()) ### extent: 00000000c33beecb ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767323389.235720:0:111001:0:(osc_cache.c:483:__osc_extent_remove()) ### extent: 00000000c33beecb ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767323389.235753:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975824896:192.168.204.130@tcp:4:bash.0 00000080:00200000:2.0:1767323389.235787:0:125439:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767323389.235874:0:125439:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1767323389.235904:0:125439:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800028400000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323389.235925:0:125439:0:(osc_cache.c:1892:try_to_add_extent_for_io()) ### extent: 00000000c1ae0a1b ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:2.0:1767323389.235941:0:125439:0:(osc_cache.c:1103:osc_extent_make_ready()) ### extent: 00000000c1ae0a1b ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.235996:0:125439:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00100000:2.0:1767323389.236099:0:125439:0:(osc_request.c:1967:osc_brw_prep_request()) brw rpc ffff94101813ad80 - object 0x280000400:162 offset 0<>6 00000100:00100000:3.0:1767323389.236164:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767323389.236181:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975825024:192.168.204.130@tcp:4:bash.0 00000008:00010000:3.0:1767323389.240808:0:111001:0:(osc_cache.c:861:osc_extent_finish()) ### extent: 00000000c1ae0a1b ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767323389.240930:0:111001:0:(osc_cache.c:483:__osc_extent_remove()) ### extent: 00000000c1ae0a1b ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800029400000000 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767323389.240973:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975825024:192.168.204.130@tcp:4:bash.0 00000080:00200000:2.0:1767323389.241244:0:125439:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1767323389.241309:0:125439:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1767323389.241475:0:125439:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804869480000020 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.241487:0:125439:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804869400000020 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.241508:0:125439:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804869400000020 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.241516:0:125439:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804869400000020 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.241522:0:125439:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 4 locks packed 00000100:00100000:2.0:1767323389.241549:0:125439:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138380 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:b504cb06-162c-4989-9f96-575f2ee3236b:125439:1853171975825152:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767323389.241657:0:125439:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b240 going to sleep for 11 seconds 00000100:00100000:2.0:1767323389.255165:0:125439:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138380 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_02:b504cb06-162c-4989-9f96-575f2ee3236b:125439:1853171975825152:192.168.204.130@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1767323389.255205:0:125439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33200/0x720c8b170b55687c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804869480000020 nid: local remote: 0x6f7fea81d46fdebe expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.255237:0:125439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33600/0x720c8b170b55683d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804869400000020 nid: local remote: 0x6f7fea81d46fde01 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.255250:0:125439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a32e00/0x720c8b170b55684b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804869400000020 nid: local remote: 0x6f7fea81d46fde2b expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.255263:0:125439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b55682f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804869400000020 nid: local remote: 0x6f7fea81d46fddd7 expref: -99 pid: 126943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323389.255294:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767323389.255297:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767323389.255300:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1767323389.974075:0:127134:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323389.974105:0:127134:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.974131:0:127134:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.974148:0:127134:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.974157:0:127134:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.974164:0:127134:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323389.974168:0:127134:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323389.976264:0:127134:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ec3b58 00010000:00010000:1.0:1767323389.976273:0:127134:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323389.976284:0:127134:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323389.976299:0:127134:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.976308:0:127134:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:1.0:1767323389.976314:0:127134:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.976318:0:127134:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:1.0:1767323389.976322:0:127134:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323389.976325:0:127134:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2, flags=8 00000080:00200008:1.0:1767323389.976333:0:127134:0:(file.c:6252:ll_getattr_dentry()) START file f2:[0x200000bd1:0x5:0x0](ffff941004bd42c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767323389.976337:0:127134:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x5:0x0](ffff941004bd42c8),name=f2 00000002:00010000:1.0:1767323389.976368:0:127134:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x5:0x0]) in obj [0x200000bd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323389.976379:0:127134:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767323389.976902:0:127134:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767323389.976923:0:127134:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x2:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323389.976930:0:127134:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) 00000080:00010000:1.0:1767323389.976934:0:127134:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) for lock 0x720c8b170b556836 00000080:00010000:1.0:1767323389.976939:0:127134:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556836 from it ffffb75487ec3cb8 00010000:00010000:1.0:1767323389.976943:0:127134:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767323389.976950:0:127134:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767323389.977013:0:127134:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767323389.977023:0:127134:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd1:0x5:0x0] 00000008:00010000:1.0:1767323389.977053:0:127134:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767323389.977056:0:127134:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941011986cb0, osc lock ffff941039754f70, flags 0x400001002 00010000:00010000:1.0:1767323389.977121:0:127134:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767323389.977128:0:127134:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767323389.977168:0:127134:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767323389.977188:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975825280:192.168.204.130@tcp:101:chown.0 00010000:00010000:1.0:1767323389.981521:0:111003:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767323389.981549:0:111003:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767323389.981563:0:111003:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767323389.981595:0:111003:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00000008:00010000:1.0:1767323389.981611:0:111003:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4, setting rss=4; kms=4, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767323389.981622:0:111003:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1767323389.981643:0:111003:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767323389.981651:0:111003:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767323389.981658:0:111003:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767323389.981666:0:111003:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1767323389.981687:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975825280:192.168.204.130@tcp:101:chown.0 00000080:00200000:2.0:1767323389.981784:0:127134:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x5:0x0] updating i_size 4 i_blocks 8 00000020:00010000:2.0:1767323389.981797:0:127134:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff941039486910 (ffff941002dc0488/0) at cl_lock_release():245 00000020:00010000:2.0:1767323389.981801:0:127134:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941039486910 (ffff941002dc0488/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767323389.981805:0:127134:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941011986cb0 (ffff941002dc0cf8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767323389.981809:0:127134:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941039486910 (ffff941002dc0488/0) at cl_lock_fini():72 00000020:00010000:2.0:1767323389.981812:0:127134:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941011986cb0 (ffff941002dc0488/1) at cl_lock_fini():72 00000080:00200000:2.0:1767323389.981825:0:127134:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x5:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767323389.981888:0:127134:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323389.981910:0:127134:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323389.981926:0:127134:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.981938:0:127134:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.981946:0:127134:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323389.982878:0:127134:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323389.982886:0:127134:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323389.982895:0:127134:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ec3bf8 00010000:00010000:2.0:1767323389.982900:0:127134:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.982911:0:127134:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323389.982924:0:127134:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.982932:0:127134:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:2.0:1767323389.982939:0:127134:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.982941:0:127134:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=25 00000080:00200000:2.0:1767323389.982945:0:127134:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323389.982959:0:127134:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f2, flags=9 00000002:00010000:2.0:1767323389.982984:0:127134:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000bd1:0x5:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1767323389.983024:0:127134:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127134 initiator: MDT0 00010000:00010000:2.0:1767323389.983029:0:127134:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127134 initiator: MDT0 00010000:00010000:2.0:1767323389.983036:0:127134:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127134 initiator: MDT0 00000100:00100000:2.0:1767323389.983054:0:127134:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138380 pname:cluuid:pid:xid:nid:opc:job chown:b504cb06-162c-4989-9f96-575f2ee3236b:127134:1853171975825408:192.168.204.130@tcp:101:chown.0 00000100:00100000:2.0:1767323389.983138:0:127134:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767323389.988032:0:127134:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138380 pname:cluuid:pid:xid:nid:opc:job chown:b504cb06-162c-4989-9f96-575f2ee3236b:127134:1853171975825408:192.168.204.130@tcp:101:chown.0 00010000:00010000:2.0:1767323389.988055:0:127134:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.988068:0:127134:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.988077:0:127134:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323389.988087:0:127134:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=80 disposition=0, status=0 req@ffff941018138380 x1853171975825408/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 568/1144 e 0 to 0 dl 1767323405 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'chown.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323389.988096:0:127134:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.988108:0:127134:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 4 res 8589937617/5 (0 0) 00000080:00200000:2.0:1767323389.988116:0:127134:0:(namei.c:955:ll_intent_lock()) intent lock 128 on i1 [0x200000bd1:0x5:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1767323389.988160:0:127134:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) for lock 0x720c8b170b55689f 00000080:00010000:2.0:1767323389.988169:0:127134:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55689f from it ffffb75487ec3bf8 00010000:00010000:2.0:1767323389.988174:0:127134:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323389.988183:0:127134:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1767323389.988221:0:127134:0:(llite_lib.c:2314:ll_setattr_raw()) START file f2:[0x200000bd1:0x5:0x0](ffff941004bd42c8) current size 4, valid attrs 1846, mode ffff, uid 1, gid 1, new size 18446625395354038272, atime 1767323389.000000000, mtime 1767323389.000000000, ctime 1767323389.000000000 00010000:00010000:2.0:1767323389.988247:0:127134:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323389.988267:0:127134:0:(vvp_object.c:114:vvp_conf_set()) [0x200000bd1:0x5:0x0]: losing layout lock 00010000:00010000:2.0:1767323389.988305:0:127134:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323389.988313:0:127134:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767323389.988315:0:127134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b556836 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fddf3 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000020:00100000:2.0:1767323389.988335:0:127134:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767323389.988341:0:127134:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941018138380 x1853171975825664/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767323389.988364:0:127134:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018138380 pname:cluuid:pid:xid:nid:opc:job chown:b504cb06-162c-4989-9f96-575f2ee3236b:127134:1853171975825664:192.168.204.130@tcp:36:chown.0 00000100:00100000:2.0:1767323389.988545:0:127134:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767323390.000638:0:127134:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018138380 pname:cluuid:pid:xid:nid:opc:job chown:b504cb06-162c-4989-9f96-575f2ee3236b:127134:1853171975825664:192.168.204.130@tcp:36:chown.0 00000080:00200000:2.0:1767323390.000698:0:127134:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:2.0:1767323390.000732:0:127134:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 31 res 8589937617/5 (0 0) 00000080:00010000:2.0:1767323390.000742:0:127134:0:(file.c:7031:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000bd1:0x5:0x0](ffff941004bd42c8) 00000002:00010000:2.0:1767323390.000753:0:127134:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x5:0x0]) in obj [0x200000bd1:0x5:0x0], intent: layout flags 0 00010000:00010000:2.0:1767323390.000793:0:127134:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 127134 initiator: MDT0 00010000:00010000:2.0:1767323390.000800:0:127134:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127134 initiator: MDT0 00010000:00010000:2.0:1767323390.000807:0:127134:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 127134 initiator: MDT0 00000100:00100000:2.0:1767323390.000822:0:127134:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job chown:b504cb06-162c-4989-9f96-575f2ee3236b:127134:1853171975825792:192.168.204.130@tcp:101:chown.0 00000100:00100000:2.0:1767323390.000924:0:127134:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1767323390.004109:0:127134:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job chown:b504cb06-162c-4989-9f96-575f2ee3236b:127134:1853171975825792:192.168.204.130@tcp:101:chown.0 00010000:00010000:2.0:1767323390.004139:0:127134:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.004603:0:127134:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00000002:00100000:2.0:1767323390.004618:0:127134:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@ffff94101813b480 x1853171975825792/t0(0) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 376/408 e 0 to 0 dl 1767323406 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'chown.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323390.004627:0:127134:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 64 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00000002:00010000:2.0:1767323390.004639:0:127134:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.004649:0:127134:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff941018334400 type 13 mode 16 res 8589937617/5 (0 0) 00000080:00200000:2.0:1767323390.004664:0:127134:0:(namei.c:955:ll_intent_lock()) intent lock 1024 on i1 [0x200000bd1:0x5:0x0] suppgids -1 -1: rc 0 00000080:00010000:2.0:1767323390.004681:0:127134:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x5:0x0](ffff941004bd42c8) for lock 0x720c8b170b5568a6 00000080:00010000:2.0:1767323390.004688:0:127134:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5568a6 from it ffffb75487ec3ab8 00010000:00010000:2.0:1767323390.004692:0:127134:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.004700:0:127134:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.004724:0:127134:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 2/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.004734:0:127134:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 2/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00000080:00010000:2.0:1767323390.004742:0:127134:0:(file.c:6914:ll_layout_lock_set()) ### file [0x200000bd1:0x5:0x0](00000000d02caa3e) being reconfigured ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323390.004778:0:127134:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x5:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:2.0:1767323390.004782:0:127134:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.004787:0:127134:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00020000:00200000:2.0:1767323390.004802:0:127134:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:0.0:1767323390.004927:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975825920:192.168.204.130@tcp:2:chown.0 00000100:00100000:0.0:1767323390.011180:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975825920:192.168.204.130@tcp:2:chown.0 00000080:00200000:2.0:1767323390.011258:0:127134:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1767323390.011272:0:127134:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f2:[0x200000bd1:0x5:0x0](ffff941004bd42c8) current size 4, valid attrs 1846, mode ffff, uid 1, gid 1, new size 18446625395354038272, atime 1767323389.000000000, mtime 1767323389.000000000, ctime 1767323389.000000000, rc 0 00000080:00200000:2.0:1767323390.029516:0:127135:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323390.029549:0:127135:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323390.029567:0:127135:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.029582:0:127135:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323390.029591:0:127135:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323390.029598:0:127135:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323390.029601:0:127135:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323390.029609:0:127135:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ebbb58 00010000:00010000:2.0:1767323390.029613:0:127135:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.029621:0:127135:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323390.029637:0:127135:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323390.029645:0:127135:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:2.0:1767323390.029650:0:127135:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323390.029654:0:127135:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:2.0:1767323390.029659:0:127135:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323390.029663:0:127135:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f4, flags=8 00000080:00200008:2.0:1767323390.029668:0:127135:0:(file.c:6252:ll_getattr_dentry()) START file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1767323390.029673:0:127135:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x7:0x0](ffff941004bd00c8),name=f4 00000002:00010000:2.0:1767323390.029685:0:127135:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x7:0x0]) in obj [0x200000bd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323390.029693:0:127135:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.029701:0:127135:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323390.029715:0:127135:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x2:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323390.029720:0:127135:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000080:00010000:2.0:1767323390.029722:0:127135:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) for lock 0x720c8b170b556883 00000080:00010000:2.0:1767323390.029727:0:127135:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556883 from it ffffb75487ebbcb8 00010000:00010000:2.0:1767323390.029729:0:127135:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.029737:0:127135:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323390.029755:0:127135:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:2.0:1767323390.029766:0:127135:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd1:0x7:0x0] 00000008:00010000:2.0:1767323390.029786:0:127135:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1767323390.029790:0:127135:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941010b6bdb0, osc lock ffff941006c69430, flags 0x400001002 00010000:00010000:2.0:1767323390.029853:0:127135:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323390.029861:0:127135:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00000020:00200000:2.0:1767323390.029893:0:127135:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1767323390.030602:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975826048:192.168.204.130@tcp:101:chown.0 00010000:00010000:0.0:1767323390.037556:0:111001:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.037583:0:111001:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.037598:0:111001:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.037610:0:111001:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767323390.037624:0:111001:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 4, setting rss=4; kms=4, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767323390.037634:0:111001:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767323390.037644:0:111001:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.037652:0:111001:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.037679:0:111001:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.037687:0:111001:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767323390.037707:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975826048:192.168.204.130@tcp:101:chown.0 00000080:00200000:2.0:1767323390.037818:0:127135:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x7:0x0] updating i_size 4 i_blocks 8 00000020:00010000:2.0:1767323390.037824:0:127135:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff941039486910 (ffff941002dc0488/0) at cl_lock_release():245 00000020:00010000:2.0:1767323390.037827:0:127135:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941039486910 (ffff941002dc0488/0) at cl_lock_cancel():142 00000020:00010000:2.0:1767323390.037833:0:127135:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941010b6bdb0 (ffff941002dc0cf8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1767323390.037867:0:127135:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941039486910 (ffff941002dc0488/0) at cl_lock_fini():72 00000020:00010000:2.0:1767323390.037870:0:127135:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941010b6bdb0 (ffff941002dc0488/1) at cl_lock_fini():72 00000080:00200000:2.0:1767323390.037884:0:127135:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/1, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1767323390.037938:0:127135:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:2.0:1767323390.037971:0:127135:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1767323390.037988:0:127135:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.037998:0:127135:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323390.038005:0:127135:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1767323390.038012:0:127135:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:2.0:1767323390.038016:0:127135:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:2.0:1767323390.038021:0:127135:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ebbbf8 00010000:00010000:2.0:1767323390.038024:0:127135:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.038030:0:127135:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1767323390.038040:0:127135:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323390.038046:0:127135:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=25 00000080:00200000:2.0:1767323390.038052:0:127135:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:2.0:1767323390.038055:0:127135:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=25 00000080:00200000:2.0:1767323390.038060:0:127135:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:2.0:1767323390.038063:0:127135:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f4, flags=9 00000080:00200008:2.0:1767323390.038090:0:127135:0:(llite_lib.c:2314:ll_setattr_raw()) START file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8) current size 4, valid attrs 1846, mode ffff, uid 1, gid 1, new size 18446625395354038272, atime 1767323390.000000000, mtime 1767323390.000000000, ctime 1767323390.000000000 00010000:00010000:2.0:1767323390.038108:0:127135:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.038123:0:127135:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.038313:0:127135:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.038321:0:127135:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767323390.038324:0:127135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33800/0x720c8b170b556883 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdeda expref: -99 pid: 127111 timeout: 0 lvb_type: 3 00000020:00100000:2.0:1767323390.038344:0:127135:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1767323390.038354:0:127135:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff94101813bb80 x1853171975826304/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1767323390.038380:0:127135:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job chown:b504cb06-162c-4989-9f96-575f2ee3236b:127135:1853171975826304:192.168.204.130@tcp:36:chown.0 00000100:00100000:2.0:1767323390.038943:0:127135:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103971b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1767323390.044725:0:127135:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff94101813bb80 pname:cluuid:pid:xid:nid:opc:job chown:b504cb06-162c-4989-9f96-575f2ee3236b:127135:1853171975826304:192.168.204.130@tcp:36:chown.0 00000080:00200000:0.0:1767323390.044772:0:127135:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767323390.044786:0:127135:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767323390.044817:0:127135:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:2.0:1767323390.044929:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975826432:192.168.204.130@tcp:2:chown.0 00000100:00100000:2.0:1767323390.052033:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975826432:192.168.204.130@tcp:2:chown.0 00000080:00200000:0.0:1767323390.052112:0:127135:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 0/0, layout version 2 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1767323390.052139:0:127135:0:(llite_lib.c:2564:ll_setattr_raw()) COMPLETED file f4:[0x200000bd1:0x7:0x0](ffff941004bd00c8) current size 4, valid attrs 1846, mode ffff, uid 1, gid 1, new size 18446625395354038272, atime 1767323390.000000000, mtime 1767323390.000000000, ctime 1767323390.000000000, rc 0 00000080:00200000:0.0:1767323390.060551:0:127136:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323390.060579:0:127136:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323390.060595:0:127136:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323390.060611:0:127136:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323390.060619:0:127136:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323390.060626:0:127136:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323390.060629:0:127136:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323390.060640:0:127136:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ef3b58 00010000:00010000:0.0:1767323390.060644:0:127136:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323390.060653:0:127136:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323390.060667:0:127136:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323390.060674:0:127136:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:0.0:1767323390.060679:0:127136:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:0.0:1767323390.060682:0:127136:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:0.0:1767323390.060687:0:127136:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323390.060691:0:127136:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f1, flags=8 00000080:00200008:0.0:1767323390.060696:0:127136:0:(file.c:6252:ll_getattr_dentry()) START file f1:[0x200000bd1:0x4:0x0](ffff94102fa20908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1767323390.060706:0:127136:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x4:0x0](ffff94102fa20908),name=f1 00000002:00010000:0.0:1767323390.060719:0:127136:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x4:0x0]) in obj [0x200000bd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323390.060726:0:127136:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323390.060733:0:127136:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767323390.060739:0:127136:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x2:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323390.060743:0:127136:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x4:0x0](ffff94102fa20908) 00000080:00010000:0.0:1767323390.060746:0:127136:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x4:0x0](ffff94102fa20908) for lock 0x720c8b170b556828 00000080:00010000:0.0:1767323390.060749:0:127136:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556828 from it ffffb75487ef3cb8 00010000:00010000:0.0:1767323390.060752:0:127136:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323390.060769:0:127136:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767323390.060789:0:127136:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x4:0x0] ignore/verify layout 0/1, layout version 2 restore needed 0 00000001:00010000:0.0:1767323390.060799:0:127136:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd1:0x4:0x0] 00000008:00010000:0.0:1767323390.060816:0:127136:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1767323390.060819:0:127136:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff941011b408b0, osc lock ffff941039dee390, flags 0x400001002 00010000:00010000:0.0:1767323390.060883:0:127136:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.060891:0:127136:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767323390.060928:0:127136:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1767323390.061518:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975826560:192.168.204.130@tcp:101:rm.0 00010000:00010000:3.0:1767323390.067415:0:111003:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323390.067443:0:111003:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323390.067458:0:111003:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323390.067470:0:111003:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00000008:00010000:3.0:1767323390.067486:0:111003:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 6, setting rss=6; kms=6, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00000020:00200000:3.0:1767323390.067497:0:111003:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1767323390.067515:0:111003:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323390.067522:0:111003:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323390.067530:0:111003:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323390.067559:0:111003:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1767323390.067580:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975826560:192.168.204.130@tcp:101:rm.0 00000080:00200000:0.0:1767323390.073584:0:127136:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x4:0x0] updating i_size 6 i_blocks 8 00000020:00010000:0.0:1767323390.073596:0:127136:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff941039cc3b50 (ffff941010be97e8/0) at cl_lock_release():245 00000020:00010000:0.0:1767323390.073601:0:127136:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941039cc3b50 (ffff941010be97e8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1767323390.073606:0:127136:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941011b408b0 (ffff941010be9248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1767323390.073612:0:127136:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941039cc3b50 (ffff941010be97e8/0) at cl_lock_fini():72 00000020:00010000:0.0:1767323390.073615:0:127136:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941011b408b0 (ffff941010be97e8/1) at cl_lock_fini():72 00000080:00200000:0.0:1767323390.073627:0:127136:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x4:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767323390.073681:0:127136:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:0.0:1767323390.073866:0:127136:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1767323390.073885:0:127136:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323390.073901:0:127136:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323390.073919:0:127136:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1767323390.073927:0:127136:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:0.0:1767323390.073931:0:127136:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:0.0:1767323390.073937:0:127136:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ef3c10 00010000:00010000:0.0:1767323390.073943:0:127136:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323390.073951:0:127136:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1767323390.073967:0:127136:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323390.073974:0:127136:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:0.0:1767323390.073979:0:127136:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:0.0:1767323390.073983:0:127136:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:0.0:1767323390.073997:0:127136:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:0.0:1767323390.074006:0:127136:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f1, flags=0 00000080:00200000:0.0:1767323390.074010:0:127136:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 3 00000080:00200000:0.0:1767323390.074015:0:127136:0:(namei.c:2354:ll_unlink()) VFS Op:name=f1, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8) 00010000:00010000:0.0:1767323390.074049:0:127136:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767323390.074066:0:127136:0:(vvp_object.c:114:vvp_conf_set()) [0x200000bd1:0x4:0x0]: losing layout lock 00010000:00010000:0.0:1767323390.074110:0:127136:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323390.074117:0:127136:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767323390.074120:0:127136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b556828 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fddc2 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000020:00100000:0.0:1767323390.074156:0:127136:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1767323390.074169:0:127136:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941011be6680 x1853171975826816/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 488/752 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1767323390.074195:0:127136:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127136:1853171975826816:192.168.204.130@tcp:36:rm.0 00000100:00100000:0.0:1767323390.074933:0:127136:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 11 seconds 00000100:00100000:0.0:1767323390.084554:0:127136:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127136:1853171975826816:192.168.204.130@tcp:36:rm.0 00000080:00200000:0.0:1767323390.084621:0:127136:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767323390.084635:0:127136:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767323390.084667:0:127136:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767323390.084675:0:127136:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000bd1:0x4:0x0](ffff94102fa20908) 00000008:00010000:0.0:1767323390.084706:0:127136:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 6 blocks 8 [cma]time: 1767323388 1767323388 0 by oinfo size 6 blocks 8 [cma]time 1767323388 1767323388 0 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00000080:00200000:1.0:1767323390.091678:0:127137:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323390.091709:0:127137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323390.091730:0:127137:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323390.091757:0:127137:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323390.091765:0:127137:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323390.091773:0:127137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323390.091777:0:127137:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323390.091784:0:127137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ec3b58 00010000:00010000:1.0:1767323390.091788:0:127137:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323390.091796:0:127137:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323390.091812:0:127137:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323390.091821:0:127137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:1.0:1767323390.091827:0:127137:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323390.091831:0:127137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:1.0:1767323390.091851:0:127137:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323390.091855:0:127137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f3, flags=8 00000080:00200008:1.0:1767323390.091862:0:127137:0:(file.c:6252:ll_getattr_dentry()) START file f3:[0x200000bd1:0x6:0x0](ffff941004bd3a88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767323390.104364:0:127137:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x6:0x0](ffff941004bd3a88),name=f3 00000002:00010000:1.0:1767323390.104418:0:127137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x6:0x0]) in obj [0x200000bd1:0x2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323390.104436:0:127137:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767323390.104452:0:127137:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767323390.104475:0:127137:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x2:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323390.104483:0:127137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x6:0x0](ffff941004bd3a88) 00000080:00010000:1.0:1767323390.104487:0:127137:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x6:0x0](ffff941004bd3a88) for lock 0x720c8b170b556844 00000080:00010000:1.0:1767323390.104494:0:127137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b556844 from it ffffb75487ec3cb8 00010000:00010000:1.0:1767323390.104498:0:127137:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767323390.104507:0:127137:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767323390.104557:0:127137:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00000001:00010000:1.0:1767323390.104567:0:127137:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000bd1:0x6:0x0] 00000008:00010000:1.0:1767323390.104594:0:127137:0:(lustre_osc.h:163:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1767323390.104598:0:127137:0:(osc_lock.c:1248:osc_lock_init()) ### lock ffff9410119869b0, osc lock ffff941039754720, flags 0x400001002 00010000:00010000:1.0:1767323390.104650:0:127137:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1767323390.104659:0:127137:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400001000 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00000020:00200000:1.0:1767323390.104688:0:127137:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1767323390.104713:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975826944:192.168.204.130@tcp:101:rm.0 00010000:00010000:3.0:1767323390.105045:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105054:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105075:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105081:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105098:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105104:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105122:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105127:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105377:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105427:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105451:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105456:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105472:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105478:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105497:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323390.105503:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 11 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00000100:00100000:3.0:1767323390.105558:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767323390.105569:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975827072:192.168.204.130@tcp:63:ll_sa.0 00010000:00010000:0.0:1767323390.117235:0:111004:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.117265:0:111004:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 6/2,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.117281:0:111004:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.117294:0:111004:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00000008:00010000:0.0:1767323390.117332:0:111004:0:(osc_lock.c:179:osc_lock_lvb_update()) ### acquired size 6, setting rss=6; kms=6, end=18446744073709551615 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 5/2,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00000020:00200000:0.0:1767323390.117344:0:111004:0:(cl_io.c:1802:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1767323390.117359:0:111004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 6/2,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.117368:0:111004:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.117376:0:111004:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 5/1,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323390.117404:0:111004:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767323390.117425:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975826944:192.168.204.130@tcp:101:rm.0 00000080:00200000:1.0:1767323390.117631:0:127137:0:(file.c:1686:ll_merge_attr_nolock()) [0x200000bd1:0x6:0x0] updating i_size 6 i_blocks 8 00000020:00010000:1.0:1767323390.117638:0:127137:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff941039487d98 (ffff941002dc0c68/0) at cl_lock_release():245 00000020:00010000:1.0:1767323390.117642:0:127137:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff941039487d98 (ffff941002dc0c68/0) at cl_lock_cancel():142 00000020:00010000:1.0:1767323390.117646:0:127137:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9410119869b0 (ffff941002dc0f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1767323390.117651:0:127137:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff941039487d98 (ffff941002dc0c68/0) at cl_lock_fini():72 00000020:00010000:1.0:1767323390.117662:0:127137:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9410119869b0 (ffff941002dc0c68/1) at cl_lock_fini():72 00000080:00200000:1.0:1767323390.117675:0:127137:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x6:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767323390.117731:0:127137:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323390.117758:0:127137:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323390.117774:0:127137:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323390.117787:0:127137:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323390.117795:0:127137:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323390.117803:0:127137:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323390.117808:0:127137:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323390.117815:0:127137:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487ec3c10 00010000:00010000:1.0:1767323390.117818:0:127137:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323390.117825:0:127137:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323390.117845:0:127137:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323390.117853:0:127137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d18e.sanity-lfsck, flags=24 00000080:00200000:1.0:1767323390.117860:0:127137:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248), inode mode 41ed mask 1 00000080:00200000:1.0:1767323390.117864:0:127137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=a1, flags=24 00000080:00200000:1.0:1767323390.117870:0:127137:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 1 00000080:00200000:1.0:1767323390.117879:0:127137:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f3, flags=0 00000080:00200000:1.0:1767323390.117889:0:127137:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8), inode mode 41ed mask 3 00000080:00200000:1.0:1767323390.117894:0:127137:0:(namei.c:2354:ll_unlink()) VFS Op:name=f3, dir=[0x200000bd1:0x2:0x0](ffff9410411d21c8) 00010000:00010000:1.0:1767323390.117935:0:127137:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1767323390.117959:0:127137:0:(vvp_object.c:114:vvp_conf_set()) [0x200000bd1:0x6:0x0]: losing layout lock 00010000:00010000:1.0:1767323390.118006:0:127137:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1767323390.118012:0:127137:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767323390.118015:0:127137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32a00/0x720c8b170b556844 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fde1d expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00000020:00100000:1.0:1767323390.118041:0:127137:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1767323390.118050:0:127137:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff941010e3d180 x1853171975827328/t0(0) o36->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 488/752 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1767323390.118074:0:127137:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3d180 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127137:1853171975827328:192.168.204.130@tcp:36:rm.0 00000100:00100000:1.0:1767323390.118184:0:127137:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410088de840 going to sleep for 11 seconds 00000100:00100000:1.0:1767323390.124088:0:127137:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3d180 pname:cluuid:pid:xid:nid:opc:job rm:b504cb06-162c-4989-9f96-575f2ee3236b:127137:1853171975827328:192.168.204.130@tcp:36:rm.0 00000080:00200000:1.0:1767323390.124170:0:127137:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1767323390.124186:0:127137:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1767323390.124216:0:127137:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1767323390.124224:0:127137:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000bd1:0x6:0x0](ffff941004bd3a88) 00010000:00010000:2.0:1767323390.124251:0:111002:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 11 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00000008:00010000:1.0:1767323390.124259:0:127137:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 6 blocks 8 [cma]time: 1767323388 1767323388 0 by oinfo size 6 blocks 8 [cma]time 1767323388 1767323388 0 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1767323390.124270:0:111002:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.124281:0:111002:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.124292:0:111002:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.124323:0:111002:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.124336:0:111002:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.124345:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323390.124353:0:111002:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323390.124365:0:111002:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff9410118eb100 x1853171975827072/t0(0) o63->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:24/4 lens 3408/7976 e 0 to 0 dl 1767323406 ref 1 fl Interpret:RQU/200/0 rc -2/-2 job:'ll_sa.0' uid:0 gid:0 projid:4294967295 00000002:00010000:2.0:1767323390.124377:0:111002:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 256 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1767323390.124413:0:111002:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5568c2 from it ffff94101815a188 00010000:00010000:2.0:1767323390.124417:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.124425:0:111002:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.124450:0:111002:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124458:0:111002:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124472:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124478:0:111002:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124486:0:111002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 10 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124492:0:111002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a2e00 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323390.124496:0:111002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124502:0:111002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124508:0:111002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x20e400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124515:0:111002:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323390.124519:0:111002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124525:0:111002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2e00/0x720c8b170b5568c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 10 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124542:0:111002:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124548:0:111002:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124563:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124575:0:111002:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124582:0:111002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124587:0:111002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a3200 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323390.124590:0:111002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124596:0:111002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124602:0:111002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x20e400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124607:0:111002:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323390.124610:0:111002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124616:0:111002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3200/0x720c8b170b5568d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 9 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124631:0:111002:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124637:0:111002:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124642:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124647:0:111002:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124659:0:111002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124664:0:111002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a2a00 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323390.124668:0:111002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124686:0:111002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124692:0:111002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x20e400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124697:0:111002:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323390.124701:0:111002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124706:0:111002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2a00/0x720c8b170b5568d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 8 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124720:0:111002:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124726:0:111002:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124731:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124737:0:111002:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124742:0:111002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124753:0:111002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a3800 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323390.124756:0:111002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124761:0:111002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124767:0:111002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x20e400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124772:0:111002:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323390.124775:0:111002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124779:0:111002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3800/0x720c8b170b5568de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 7 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124791:0:111002:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124796:0:111002:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124801:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124806:0:111002:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124812:0:111002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124817:0:111002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a2400 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323390.124825:0:111002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124830:0:111002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124847:0:111002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x20e400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124851:0:111002:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323390.124854:0:111002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124860:0:111002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2400/0x720c8b170b5568e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 6 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124872:0:111002:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124877:0:111002:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124882:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124887:0:111002:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124892:0:111002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124896:0:111002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a2800 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323390.124899:0:111002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124914:0:111002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124919:0:111002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x20e400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124924:0:111002:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323390.124927:0:111002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124932:0:111002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2800/0x720c8b170b5568ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 5 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124944:0:111002:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124949:0:111002:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124955:0:111002:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124960:0:111002:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124966:0:111002:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124971:0:111002:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941039716200 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323390.124974:0:111002:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124979:0:111002:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124991:0:111002:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x20e400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.124995:0:111002:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323390.124998:0:111002:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323390.125004:0:111002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039716200/0x720c8b170b5568f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00000100:00100000:2.0:1767323390.125021:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975827072:192.168.204.130@tcp:63:ll_sa.0 00010000:00010000:2.0:1767323390.125055:0:118030:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 3 00000080:00200000:2.0:1767323390.125094:0:118030:0:(namei.c:151:ll_iget()) got inode: [0x200000bd1:0x7:0x0](ffff941004bd00c8): rc = 0 00000080:00200000:2.0:1767323390.125106:0:118030:0:(file.c:6809:ll_layout_conf()) [0x200000bd1:0x7:0x0]: layout version change: 2 -> 2 00000080:00010000:2.0:1767323390.125111:0:118030:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x7:0x0](ffff941004bd00c8) for lock 0x720c8b170b5568c2 00000080:00010000:2.0:1767323390.125121:0:118030:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5568c2 from it ffff94101815a188 00010000:00010000:2.0:1767323390.125124:0:118030:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1767323390.125131:0:118030:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1767323390.143258:0:120440:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767323390.143277:0:120440:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1767323390.143302:0:120440:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1767323390.143311:0:120440:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1767323390.143315:0:120440:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1767323390.143318:0:120440:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1767323390.143322:0:120440:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1767323390.152579:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323390.664443:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767323390.664544:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767323390.664564:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975827840:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323390.664564:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975827584:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323390.664630:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111001:1853171975827456:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323390.664720:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975827712:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323390.669444:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975827840:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323390.688767:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975827584:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323390.689335:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941018139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111001:1853171975827456:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323390.690986:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975827712:192.168.204.130@tcp:400:kworker.0 00010000:00010000:2.0:1767323391.175664:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323392.203212:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:3.0:1767323393.190429:0:127170:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767323393.190444:0:127170:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:3.0:1767323393.194652:0:127170:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323393.194695:0:127170:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323393.194712:0:127170:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323393.194721:0:127170:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323393.194733:0:127170:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:3.0:1767323393.194737:0:127170:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:3.0:1767323393.194745:0:127170:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487fc3cb8 00010000:00010000:3.0:1767323393.194750:0:127170:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323393.194758:0:127170:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323393.230974:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323394.248162:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1767323394.585179:0:127171:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767323394.585196:0:127171:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323394.585221:0:127171:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323394.585238:0:127171:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323394.585253:0:127171:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323394.585262:0:127171:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323394.585270:0:127171:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323394.585273:0:127171:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323394.585281:0:127171:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487fabcb8 00010000:00010000:1.0:1767323394.585285:0:127171:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323394.585293:0:127171:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1767323394.585504:0:127171:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff9410411d63c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767323394.585510:0:127171:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8),name=/ 00000002:00010000:1.0:1767323394.585518:0:127171:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323394.585526:0:127171:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323394.585535:0:127171:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1767323394.585542:0:127171:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1767323394.585553:0:127171:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00010000:1.0:1767323394.585556:0:127171:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9410411d63c8) for lock 0x720c8b170b5567bf 00000080:00010000:1.0:1767323394.585561:0:127171:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b5567bf from it ffffb75487fabcb8 00010000:00010000:1.0:1767323394.585565:0:127171:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323394.585572:0:127171:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323395.272353:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767323395.783940:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975828352:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323395.784083:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767323395.784091:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111001:1853171975827968:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323395.784134:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975828224:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323395.784161:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1767323395.784166:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975828096:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323395.798973:0:111004:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410107bd800: committing for last_committed 8589934636 gen 1 00000100:00100000:2.0:1767323395.799115:0:111004:0:(client.c:3130:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff941010e3c000 x1853171975824128/t8589934632(8589934632) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1767323395.799143:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975828096:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323395.799159:0:111004:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410107bd800: committing for last_committed 8589934594 gen 1 00000100:00100000:2.0:1767323395.799164:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975828224:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323395.800185:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111001:1853171975827968:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323395.800201:0:111001:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9410107bd800: committing for last_committed 8589934607 gen 2 00000100:00100000:2.0:1767323395.800225:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975828352:192.168.204.130@tcp:400:kworker.0 00010000:00010000:1.0:1767323396.295712:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323397.320278:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323398.343766:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323399.367909:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323400.157603:0:110996:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.130@tcp (source: 12345-192.168.204.130@tcp) 00000100:00100000:1.0:1767323400.157675:0:110996:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.130@tcp (source: 12345-192.168.204.130@tcp) 00000100:00100000:3.0:1767323400.157928:0:125434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853172047282816 00000100:00100000:3.0:1767323400.157940:0:125434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853172047282816 00000100:00100000:3.0:1767323400.157989:0:125434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853172047282944 00000100:00100000:3.0:1767323400.157992:0:125434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853172047282944 00000100:00100000:3.0:1767323400.158009:0:125434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.130@tcp, seq: 2 00000100:00100000:3.0:1767323400.158019:0:125434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff941010e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:273355:x1853172047282816:12345-192.168.204.130@tcp:104: 00010000:00010000:3.0:1767323400.158039:0:125434:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.158149:0:125434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1767323400.158182:0:125434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff941010e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:273355:x1853172047282816:12345-192.168.204.130@tcp:104: Request processed in 164us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1767323400.158191:0:125434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.130@tcp, seq: 2 00000100:00100000:3.0:1767323400.158212:0:125434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.130@tcp, seq: 3 00000100:00100000:3.0:1767323400.158227:0:125434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff941010e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:273641:x1853172047282944:12345-192.168.204.130@tcp:104: 00010000:00010000:3.0:1767323400.158236:0:125434:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.158272:0:125434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1767323400.158278:0:125434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff941010e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:273641:x1853172047282944:12345-192.168.204.130@tcp:104: Request processed in 60us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1767323400.158284:0:125434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.130@tcp, seq: 3 00010000:00010000:3.0:1767323400.158304:0:125439:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1767323400.159155:0:125439:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159180:0:125439:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941010aee800 already unused, calling callback (ffffffffc12690e0) 00010000:00010000:3.0:1767323400.159187:0:125439:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159257:0:125439:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159265:0:125439:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767323400.159307:0:125439:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1767323400.159617:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1767323400.159643:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975828480:192.168.204.130@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1767323400.159829:0:125439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941010aee800/0x720c8b170b5568b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x6f7fea81d46fdf89 expref: -99 pid: 127136 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159876:0:125439:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1767323400.159881:0:125439:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159889:0:125439:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941018106e00 already unused, calling callback (ffffffffc12690e0) 00010000:00010000:3.0:1767323400.159894:0:125439:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159922:0:125439:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159930:0:125439:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767323400.159959:0:125439:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159967:0:125439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018106e00/0x720c8b170b5568bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x6f7fea81d46fdfac expref: -99 pid: 127137 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1767323400.159984:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323400.159986:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323400.159988:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767323400.160106:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975828608:192.168.204.130@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767323400.160432:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767323400.166052:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975828480:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1767323400.170669:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975828608:192.168.204.130@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1767323400.392277:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323400.904410:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1767323400.904527:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975828864:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323400.904582:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975828992:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323400.904648:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975829120:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323400.905107:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111003:1853171975828736:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323400.908891:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975828864:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323400.921037:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975828992:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323400.921094:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975829120:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323400.921128:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111003:1853171975828736:192.168.204.130@tcp:400:kworker.0 00010000:00010000:1.0:1767323401.417832:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323402.439629:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323403.464107:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323404.487566:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323405.516303:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767323406.023755:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111004:1853171975829248:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323406.024186:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975829376:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323406.024500:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767323406.024507:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975829504:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323406.025889:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1767323406.025908:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975829632:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323406.029294:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111004:1853171975829248:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323406.030563:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975829376:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323406.031887:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975829504:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323406.035607:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975829632:192.168.204.130@tcp:400:kworker.0 00010000:00010000:3.0:1767323406.535613:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323407.560085:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323408.583587:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323409.609632:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323410.631541:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323411.144264:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1767323411.144477:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975830016:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323411.144478:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975829888:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323411.145613:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975830144:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323411.147273:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111003:1853171975829760:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323411.154458:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975830016:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323411.154677:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b504cb06-162c-4989-9f96-575f2ee3236b:111001:1853171975829888:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323411.158640:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111003:1853171975829760:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323411.161925:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975830144:192.168.204.130@tcp:400:kworker.0 00010000:00010000:1.0:1767323411.655724:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323412.681571:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323413.703981:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323414.727532:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323415.755441:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767323416.264710:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975830528:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323416.264835:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767323416.264842:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975830400:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323416.265550:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111004:1853171975830272:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323416.265608:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1767323416.265617:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975830656:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323416.269746:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975830528:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323416.270691:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b504cb06-162c-4989-9f96-575f2ee3236b:111002:1853171975830400:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323416.272747:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b504cb06-162c-4989-9f96-575f2ee3236b:111004:1853171975830656:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323416.272764:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111004:1853171975830272:192.168.204.130@tcp:400:kworker.0 00010000:00010000:3.0:1767323416.775801:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323417.799654:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323418.823683:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323419.848939:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323420.361843:0:127138:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 127138 initiator: MDT0 00010000:00010000:3.0:1767323420.361872:0:127138:0:(ldlm_request.c:1177:ldlm_cli_lock_create_pack()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00000100:00100000:2.0:1767323420.362108:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1767323420.362162:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975830784:192.168.204.130@tcp:63:ll_sa.0 00010000:00010000:2.0:1767323420.371785:0:111003:0:(ldlm_request.c:631:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x0 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371809:0:111003:0:(ldlm_request.c:548:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371817:0:111003:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371826:0:111003:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371835:0:111003:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371841:0:111003:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941039717400 already unused, calling callback (ffffffffc1bb0b40) 00010000:00010000:2.0:1767323420.371846:0:111003:0:(ldlm_request.c:1595:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371854:0:111003:0:(ldlm_request.c:1605:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x206400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371890:0:111003:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x20e400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371898:0:111003:0:(ldlm_request.c:1301:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1767323420.371906:0:111003:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00010000:00010000:2.0:1767323420.371913:0:111003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941039717400/0x720c8b170b5568fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x3 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 127138 initiator: MDT0 00000100:00100000:2.0:1767323420.371952:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b504cb06-162c-4989-9f96-575f2ee3236b:111003:1853171975830784:192.168.204.130@tcp:63:ll_sa.0 00000080:00200000:3.0:1767323420.519616:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9410411d63c8) 00000080:00200000:3.0:1767323420.519663:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000bd1:0x1:0x0](ffff941004bd3248) 00000080:00200000:3.0:1767323420.519678:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000002:0x1:0x0](ffff941004bd1148) 00000080:00200000:3.0:1767323420.519687:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000002:0x3:0x0](ffff9410411d5348) 00000080:00200000:3.0:1767323420.519763:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000403:0x1:0x0](ffff941004bd6c08) 00000080:00200000:3.0:1767323420.519803:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x240000402:0x1:0x0](ffff9410411d6c08) 00000080:00200000:3.0:1767323420.519816:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000bd1:0x2:0x0](ffff9410411d21c8) 00000002:00100000:3.0:1767323420.519881:0:127171:0:(mdc_request.c:963:mdc_close()) @@@ matched open req@ffff941010e3c000 x1853171975824128/t8589934632(8589934632) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1767323420.519896:0:127171:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9410107bd800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1767323420.519901:0:127171:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9410118eb100 x1853171975831040/t0(0) o35->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:23/10 lens 392/752 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1767323420.519928:0:127171:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eb100 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975831040:192.168.204.130@tcp:35:umount.0 00000100:00100000:3.0:1767323420.520079:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff9410118b0540 going to sleep for 11 seconds 00000100:00100000:3.0:1767323420.527095:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eb100 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975831040:192.168.204.130@tcp:35:umount.0 00000002:00100000:3.0:1767323420.527147:0:127171:0:(mdc_request.c:831:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff941010e3c000 x1853171975824128/t8589934632(8589934632) o101->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 776/608 e 0 to 0 dl 1767323405 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1767323420.527207:0:127171:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767323420.527220:0:127171:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1767323420.527249:0:127171:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767323420.527258:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000bd1:0x5:0x0](ffff941004bd42c8) 00000008:00010000:3.0:1767323420.527342:0:127171:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4 blocks 8 [cma]time: 1767323388 1767323388 0 by oinfo size 4 blocks 8 [cma]time 1767323389 1767323388 0 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767323420.527643:0:127171:0:(vvp_io.c:1854:vvp_io_init()) [0x200000bd1:0x7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1767323420.527649:0:127171:0:(lov_io.c:860:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1767323420.527654:0:127171:0:(lov_io.c:860:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1767323420.527662:0:127171:0:(vvp_io.c:289:vvp_io_fini()) [0x200000bd1:0x7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1767323420.527667:0:127171:0:(llite_lib.c:1953:ll_clear_inode()) VFS Op:inode=[0x200000bd1:0x7:0x0](ffff941004bd00c8) 00000008:00010000:3.0:1767323420.527689:0:127171:0:(osc_object.c:209:osc_object_ast_clear()) ### update lock size 4 blocks 8 [cma]time: 1767323388 1767323388 0 by oinfo size 4 blocks 8 [cma]time 1767323390 1767323388 0 ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00000080:00200000:3.0:1767323420.527737:0:127171:0:(llite_lib.c:1568:ll_put_super()) VFS Op: cfg_instance lustre-client-ffff9410107bd800 (sb ffff9410107bd800) 00010000:00010000:3.0:1767323420.527775:0:127171:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527785:0:127171:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527805:0:127171:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527813:0:127171:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527843:0:127171:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1767323420.527850:0:127171:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527857:0:127171:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527864:0:127171:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527871:0:127171:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527890:0:127171:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1767323420.527897:0:127171:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527915:0:127171:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527921:0:127171:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527928:0:127171:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323420.527936:0:127171:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1767323420.527940:0:127171:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1767323420.527990:0:125438:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1767323420.528005:0:125438:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528020:0:125438:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9410014a2200 already unused, calling callback (ffffffffc13ecc20) 10000000:00010000:1.0:1767323420.528025:0:125438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528036:0:125438:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1767323420.528046:0:125438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1767323420.528052:0:125438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1767323420.528055:0:125438:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1767323420.528060:0:125438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1767323420.528141:0:125438:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528148:0:125438:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767323420.528184:0:125438:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528191:0:125438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9410014a2200/0x720c8b170b5566f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda11 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528206:0:125438:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1767323420.528209:0:125438:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528214:0:125438:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941005bbd600 already unused, calling callback (ffffffffc13ecc20) 10000000:00010000:1.0:1767323420.528217:0:125438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528223:0:125438:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1767323420.528228:0:125438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1767323420.528234:0:125438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1767323420.528237:0:125438:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-cliir: stopping, won't requeue 10000000:01000000:1.0:1767323420.528238:0:125438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-cliir 00010000:00010000:1.0:1767323420.528251:0:125438:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528257:0:125438:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767323420.528262:0:125438:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528289:0:125438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff941005bbd600/0x720c8b170b556725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda18 expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528302:0:125438:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767323420.528306:0:125438:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528312:0:125438:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941010a51400 already unused, calling callback (ffffffffc13ecc20) 10000000:00010000:1.0:1767323420.528315:0:125438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528322:0:125438:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1767323420.528328:0:125438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1767323420.528334:0:125438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1767323420.528336:0:125438:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1767323420.528338:0:125438:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1767323420.528354:0:125438:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528360:0:125438:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767323420.528380:0:125438:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528419:0:125438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff941010a51400/0x720c8b170b556764 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda8f expref: -99 pid: 125441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767323420.528431:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323420.528439:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323420.528442:0:125438:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323420.528468:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111002:1853171975831296:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767323420.528594:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767323420.528601:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111002:1853171975831168:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767323420.528631:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1767323420.528640:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111004:1853171975831424:192.168.204.130@tcp:103:ldlm_bl.0 00020000:00020000:3.0:1767323420.530575:0:127171:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9410107bd800: lov tgt 0 not cleaned! deathrow=0, lovrc=1 00010000:00010000:0.0:1767323420.530696:0:125439:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767323420.541741:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111004:1853171975831424:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767323420.543442:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111002:1853171975831168:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767323420.543462:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111002:1853171975831296:192.168.204.130@tcp:103:ldlm_bl.0 00020000:01000000:3.0:1767323420.547060:0:127171:0:(lov_obd.c:589:lov_del_target()) uuid: lustre-OST0000_UUID idx: 0 gen: 1 exp: ffff9410089e3000 active: 1 00020000:00020000:3.0:1767323420.547072:0:127171:0:(lov_obd.c:783:lov_cleanup()) lustre-clilov-ffff9410107bd800: lov tgt 1 not cleaned! deathrow=1, lovrc=1 00020000:01000000:3.0:1767323420.547075:0:127171:0:(lov_obd.c:589:lov_del_target()) uuid: lustre-OST0001_UUID idx: 1 gen: 1 exp: ffff9410089e1000 active: 1 00020000:01000000:3.0:1767323420.547078:0:127171:0:(lov_obd.c:64:lov_tgts_putref()) destroying 2 lov targets 00020000:01000000:3.0:1767323420.547083:0:127171:0:(lov_obd.c:611:__lov_del_obd()) Removing tgt lustre-OST0001_UUID : lustre-OST0001-osc-ffff9410107bd800 00020000:01000000:3.0:1767323420.547086:0:127171:0:(lov_obd.c:248:lov_disconnect_obd()) lustre-clilov-ffff9410107bd800: disconnecting target lustre-OST0001-osc-ffff9410107bd800 00000100:00080000:3.0:1767323420.547092:0:127171:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import b504cb06-162c-4989-9f96-575f2ee3236b->lustre-OST0001_UUID 00000100:00080000:3.0:1767323420.547188:0:127171:0:(import.c:65:import_set_state_nolock()) ffff941008d1b800 lustre-OST0001_UUID: changing import state from IDLE to CLOSED 00000100:00080000:3.0:1767323420.547195:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1767323420.547200:0:127171:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9410107bd800: committing for last_committed 0 gen 2 00000100:00100000:3.0:1767323420.547205:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1767323420.547345:0:127171:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x720c8b170b556756 00000020:00000080:3.0:1767323420.547361:0:127171:0:(genops.c:904:class_export_put()) final put ffff9410089e1000/LOV_OSC_UUID 00000020:00000080:0.0:1767323420.547476:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff9410089e1000/LOV_OSC_UUID for lustre-OST0001-osc-ffff9410107bd800 00000020:01000000:0.0:1767323420.547535:0:127171:0:(obd_config.c:2361:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-ffff9410107bd800 (flags='') 00000020:00000080:0.0:1767323420.547542:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1767323420.547552:0:127171:0:(obd_config.c:886:class_cleanup()) lustre-OST0001-osc-ffff9410107bd800: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1767323420.547557:0:127171:0:(genops.c:1575:class_disconnect_exports()) OBD device 6 (ffff941006c3b1b0) has no exports 00000008:01000000:0.0:1767323420.547588:0:127171:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-OST0001-osc-ffff9410107bd800: client import never connected 00000100:00080000:0.0:1767323420.547591:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1767323420.547594:0:127171:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9410107bd800: committing for last_committed 0 gen 3 00000100:00020000:0.0:1767323420.547597:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup 00000100:00100000:0.0:1767323420.558073:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:0.0:1767323420.558084:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 6 not setup 00000020:00000080:0.0:1767323420.558369:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1767323420.558380:0:127171:0:(obd_config.c:814:class_detach()) detach on obd lustre-OST0001-osc-ffff9410107bd800 (uuid b504cb06-162c-4989-9f96-575f2ee3236b) 00000020:00000080:1.0:1767323420.558448:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff941008d1b800 for lustre-OST0001-osc-ffff9410107bd800 00000020:00000080:0.0:1767323420.558864:0:127171:0:(genops.c:904:class_export_put()) final put ffff941008d1b000/b504cb06-162c-4989-9f96-575f2ee3236b 00000020:00000080:0.0:1767323420.558867:0:127171:0:(genops.c:863:class_export_destroy()) destroying export ffff941008d1b000/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-OST0001-osc-ffff9410107bd800 00000020:01000000:0.0:1767323420.558871:0:127171:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-ffff9410107bd800 (b504cb06-162c-4989-9f96-575f2ee3236b) 00020000:01000000:0.0:1767323420.559006:0:127171:0:(lov_obd.c:611:__lov_del_obd()) Removing tgt lustre-OST0000_UUID : lustre-OST0000-osc-ffff9410107bd800 00020000:01000000:0.0:1767323420.559009:0:127171:0:(lov_obd.c:248:lov_disconnect_obd()) lustre-clilov-ffff9410107bd800: disconnecting target lustre-OST0000-osc-ffff9410107bd800 00000100:00080000:0.0:1767323420.559013:0:127171:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import b504cb06-162c-4989-9f96-575f2ee3236b->lustre-OST0000_UUID 00010000:00010000:0.0:1767323420.559030:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323420.559074:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323420.559081:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.559105:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.559130:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975831552:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.559141:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.559159:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.559161:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941018107e00/0x720c8b170b556898 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdf58 expref: -99 pid: 127134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323420.559180:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323420.559193:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1767323420.559197:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.559202:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.559207:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975831680:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.559212:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.559215:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.559217:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9410107bd800 lock: ffff941006a33000/0x720c8b170b5568ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdf7b expref: -99 pid: 127135 timeout: 0 lvb_type: 1 00000100:00080000:0.0:1767323420.559315:0:127171:0:(import.c:65:import_set_state_nolock()) ffff941008d1e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1767323420.559370:0:111000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b504cb06-162c-4989-9f96-575f2ee3236b:111000:1853171975831808:192.168.204.130@tcp:9:umount.0 00000100:00080000:1.0:1767323420.564456:0:111000:0:(import.c:65:import_set_state_nolock()) ffff941008d1e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1767323420.564483:0:111000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b504cb06-162c-4989-9f96-575f2ee3236b:111000:1853171975831808:192.168.204.130@tcp:9:umount.0 00000100:00080000:0.0:1767323420.564684:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1767323420.564689:0:127171:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9410107bd800: committing for last_committed 8589934607 gen 3 00000100:00100000:0.0:1767323420.564696:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1767323420.566959:0:127171:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x720c8b170b55674f 00000020:00000080:0.0:1767323420.566982:0:127171:0:(genops.c:904:class_export_put()) final put ffff9410089e3000/LOV_OSC_UUID 00000020:01000000:0.0:1767323420.567046:0:127171:0:(obd_config.c:2361:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-ffff9410107bd800 (flags='') 00000020:00000080:0.0:1767323420.567053:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1767323420.567061:0:127171:0:(obd_config.c:886:class_cleanup()) lustre-OST0000-osc-ffff9410107bd800: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1767323420.567066:0:127171:0:(genops.c:1575:class_disconnect_exports()) OBD device 5 (ffff941006c398d8) has no exports 00000020:00000080:1.0:1767323420.572417:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff9410089e3000/LOV_OSC_UUID for lustre-OST0000-osc-ffff9410107bd800 00000008:01000000:0.0:1767323420.573581:0:127171:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-OST0000-osc-ffff9410107bd800: client import never connected 00000100:00080000:0.0:1767323420.573603:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1767323420.573608:0:127171:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9410107bd800: committing for last_committed 8589934607 gen 4 00000100:00020000:0.0:1767323420.573613:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup 00000100:00100000:0.0:1767323420.573616:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:0.0:1767323420.573619:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup 00000020:00000080:0.0:1767323420.573911:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1767323420.573920:0:127171:0:(obd_config.c:814:class_detach()) detach on obd lustre-OST0000-osc-ffff9410107bd800 (uuid b504cb06-162c-4989-9f96-575f2ee3236b) 00000020:00000080:0.0:1767323420.573983:0:127171:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x720c8b170b556748 00000020:00000080:0.0:1767323420.573991:0:127171:0:(genops.c:904:class_export_put()) final put ffff9410089e0800/b504cb06-162c-4989-9f96-575f2ee3236b 00000100:00080000:0.0:1767323420.574337:0:127171:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import b504cb06-162c-4989-9f96-575f2ee3236b->lustre-MDT0000_UUID 00010000:00010000:0.0:1767323420.574671:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574720:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 1/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574728:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.574743:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.574755:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975831936:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.574764:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.574772:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.574776:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33a00/0x720c8b170b5567c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdc5d expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574804:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574820:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574826:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.574839:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.574844:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975832064:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.574849:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.574853:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.574855:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aeec00/0x720c8b170b5567f0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdcf0 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574888:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574901:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 1/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574906:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.574910:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.574913:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975832192:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.574918:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.574920:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.574923:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32000/0x720c8b170b5567db lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdca3 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574952:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574963:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 1/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.574968:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.574971:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.574974:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975832320:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.574984:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.574987:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.574990:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2c00/0x720c8b170b5567cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdc79 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575057:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575072:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575077:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.575082:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.575086:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975832448:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.575091:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.575094:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.575097:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33400/0x720c8b170b5567bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdc41 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575260:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575286:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575293:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.575299:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.575303:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975832576:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.575308:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.575318:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.575320:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941010aee200/0x720c8b170b55680c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdd3d expref: -99 pid: 127104 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575350:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575359:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575372:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.575379:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1767323420.575643:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff941008d1e800 for lustre-OST0000-osc-ffff9410107bd800 00000020:00000080:1.0:1767323420.575651:0:8:0:(genops.c:904:class_export_put()) final put ffff941008d1e000/b504cb06-162c-4989-9f96-575f2ee3236b 00000020:00000080:1.0:1767323420.575655:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff941008d1e000/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-OST0000-osc-ffff9410107bd800 00000020:01000000:1.0:1767323420.575661:0:8:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-ffff9410107bd800 (b504cb06-162c-4989-9f96-575f2ee3236b) 00000020:00000080:1.0:1767323420.575922:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff9410089e0800/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-clilov-ffff9410107bd800 00010000:00010000:0.0:1767323420.576029:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00000100:00100000:0.0:1767323420.576039:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.576044:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975832704:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.576049:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.576054:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.576057:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941018107c00/0x720c8b170b556891 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdf0b expref: -99 pid: 127116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.576066:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a2600/0x720c8b170b556821 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdda6 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.576205:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.576216:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.576243:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.576250:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.576255:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 2 locks packed 00000100:00100000:0.0:1767323420.576261:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.576265:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975832832:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.576279:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.576283:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.576286:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32800/0x720c8b170b5568a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdf74 expref: -99 pid: 127134 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.576296:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a32200/0x720c8b170b55689f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdf66 expref: -99 pid: 127134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.576337:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.576346:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.576353:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.576366:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.577684:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.577702:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.577708:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 3 locks packed 00000100:00100000:0.0:1767323420.577724:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.577733:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975832960:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.577742:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.577751:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.577755:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33e00/0x720c8b170b556875 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdeb7 expref: -99 pid: 126943 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.577770:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff9410014a3a00/0x720c8b170b5568c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x6f7fea81d46fdfc8 expref: -99 pid: 127138 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1767323420.577779:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9410107bd800 lock: ffff941006a33c00/0x720c8b170b55686e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdea9 expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1767323420.579588:0:127171:0:(import.c:65:import_set_state_nolock()) ffff941008d1d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1767323420.579848:0:111000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b504cb06-162c-4989-9f96-575f2ee3236b:111000:1853171975833088:192.168.204.130@tcp:39:umount.0 00000100:00080000:2.0:1767323420.582226:0:111000:0:(import.c:65:import_set_state_nolock()) ffff941008d1d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1767323420.582255:0:111000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b504cb06-162c-4989-9f96-575f2ee3236b:111000:1853171975833088:192.168.204.130@tcp:39:umount.0 00000100:00080000:0.0:1767323420.582320:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1767323420.582325:0:127171:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410107bd800: committing for last_committed 8589934636 gen 2 00000100:00100000:0.0:1767323420.582334:0:127171:0:(client.c:3119:ptlrpc_free_committed()) @@@ free request with old gen req@ffff941011be6d80 x1853171975833088/t8589934638(8589934638) o39->lustre-MDT0000-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323430 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323420.582355:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1767323420.583972:0:127171:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x720c8b170b55673a 00000020:00000080:0.0:1767323420.584000:0:127171:0:(genops.c:904:class_export_put()) final put ffff94100416a000/b504cb06-162c-4989-9f96-575f2ee3236b 00000100:00080000:0.0:1767323420.584091:0:127171:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import b504cb06-162c-4989-9f96-575f2ee3236b->lustre-MDT0001_UUID 00010000:00010000:0.0:1767323420.584147:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.584188:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.584192:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.584206:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.584215:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:b504cb06-162c-4989-9f96-575f2ee3236b:127171:1853171975833216:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.584225:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.584232:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.584235:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-mdc-ffff9410107bd800 lock: ffff941010aefa00/0x720c8b170b5567fe lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x6f7fea81d46fdd0c expref: -99 pid: 126943 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1767323420.585215:0:127171:0:(import.c:65:import_set_state_nolock()) ffff941008d1d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:1.0:1767323420.585687:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff94100416a000/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-MDT0000-mdc-ffff9410107bd800 00000100:00100000:2.0:1767323420.586350:0:111000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b504cb06-162c-4989-9f96-575f2ee3236b:111000:1853171975833344:192.168.204.130@tcp:39:umount.0 00000100:00080000:2.0:1767323420.588637:0:111000:0:(import.c:65:import_set_state_nolock()) ffff941008d1d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1767323420.588655:0:111000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b504cb06-162c-4989-9f96-575f2ee3236b:111000:1853171975833344:192.168.204.130@tcp:39:umount.0 00000100:00080000:0.0:1767323420.588882:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1767323420.588887:0:127171:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410107bd800: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1767323420.588893:0:127171:0:(client.c:3119:ptlrpc_free_committed()) @@@ free request with old gen req@ffff941011be6d80 x1853171975833344/t8589934595(8589934595) o39->lustre-MDT0001-mdc-ffff9410107bd800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323430 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323420.588908:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1767323420.592355:0:127171:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x720c8b170b556741 00000020:00000080:0.0:1767323420.592371:0:127171:0:(genops.c:904:class_export_put()) final put ffff941004168800/b504cb06-162c-4989-9f96-575f2ee3236b 00000020:00000080:0.0:1767323420.592641:0:127171:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x720c8b170b556733 00000020:00000080:0.0:1767323420.592645:0:127171:0:(genops.c:904:class_export_put()) final put ffff941008d1f000/b504cb06-162c-4989-9f96-575f2ee3236b 00000020:01000000:0.0:1767323420.592652:0:127171:0:(obd_config.c:2361:class_manual_cleanup()) Manual cleanup of lustre-clilov-ffff9410107bd800 (flags='') 00000020:00000080:0.0:1767323420.592658:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1767323420.592662:0:127171:0:(obd_config.c:886:class_cleanup()) lustre-clilov-ffff9410107bd800: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1767323420.592677:0:127171:0:(genops.c:1575:class_disconnect_exports()) OBD device 1 (ffff941005b5ca88) has no exports 00000020:00000080:0.0:1767323420.592702:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1767323420.592707:0:127171:0:(obd_config.c:814:class_detach()) detach on obd lustre-clilov-ffff9410107bd800 (uuid b504cb06-162c-4989-9f96-575f2ee3236b) 00000020:00000080:0.0:1767323420.592709:0:127171:0:(genops.c:904:class_export_put()) final put ffff941008d1c000/b504cb06-162c-4989-9f96-575f2ee3236b 00000020:00000080:0.0:1767323420.592711:0:127171:0:(genops.c:863:class_export_destroy()) destroying export ffff941008d1c000/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-clilov-ffff9410107bd800 00000020:01000000:0.0:1767323420.592722:0:127171:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-clilov-ffff9410107bd800 (b504cb06-162c-4989-9f96-575f2ee3236b) 00000020:01000000:0.0:1767323420.592728:0:127171:0:(obd_config.c:2361:class_manual_cleanup()) Manual cleanup of lustre-clilmv-ffff9410107bd800 (flags='') 00000020:00000080:0.0:1767323420.592730:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1767323420.592731:0:127171:0:(obd_config.c:886:class_cleanup()) lustre-clilmv-ffff9410107bd800: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1767323420.592733:0:127171:0:(genops.c:1575:class_disconnect_exports()) OBD device 2 (ffff941005b5b1b0) has no exports 00000020:00000080:0.0:1767323420.592774:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1767323420.592776:0:127171:0:(obd_config.c:814:class_detach()) detach on obd lustre-clilmv-ffff9410107bd800 (uuid b504cb06-162c-4989-9f96-575f2ee3236b) 00000020:01000000:0.0:1767323420.592778:0:127171:0:(obd_config.c:2361:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdc-ffff9410107bd800 (flags='') 00000020:00000080:0.0:1767323420.592780:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1767323420.592781:0:127171:0:(obd_config.c:886:class_cleanup()) lustre-MDT0001-mdc-ffff9410107bd800: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1767323420.592782:0:127171:0:(genops.c:1575:class_disconnect_exports()) OBD device 3 (ffff941005b598d8) has no exports 00000020:00000080:1.0:1767323420.592895:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff941004168800/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-MDT0001-mdc-ffff9410107bd800 00000020:00000080:1.0:1767323420.592902:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff941008d1f000/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-clilmv-ffff9410107bd800 00000020:00000080:1.0:1767323420.592909:0:8:0:(genops.c:904:class_export_put()) final put ffff941008d19800/b504cb06-162c-4989-9f96-575f2ee3236b 00000020:00000080:1.0:1767323420.592910:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff941008d19800/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-clilmv-ffff9410107bd800 00000020:01000000:1.0:1767323420.592914:0:8:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-clilmv-ffff9410107bd800 (b504cb06-162c-4989-9f96-575f2ee3236b) 00000008:01000000:0.0:1767323420.593063:0:127171:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-MDT0001-mdc-ffff9410107bd800: client import never connected 00000100:00080000:0.0:1767323420.593067:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1767323420.593071:0:127171:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410107bd800: committing for last_committed 8589934594 gen 3 00000100:00020000:0.0:1767323420.593076:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 3 not setup 00000100:00100000:0.0:1767323420.593078:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:0.0:1767323420.593081:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 3 not setup 00000020:00000080:0.0:1767323420.595036:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1767323420.595044:0:127171:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0001-mdc-ffff9410107bd800 (uuid b504cb06-162c-4989-9f96-575f2ee3236b) 00000020:01000000:0.0:1767323420.595047:0:127171:0:(obd_config.c:2361:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdc-ffff9410107bd800 (flags='') 00000020:00000080:0.0:1767323420.595049:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1767323420.595052:0:127171:0:(obd_config.c:886:class_cleanup()) lustre-MDT0000-mdc-ffff9410107bd800: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1767323420.595055:0:127171:0:(genops.c:1575:class_disconnect_exports()) OBD device 4 (ffff941005b5e360) has no exports 00000020:00000080:1.0:1767323420.598924:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff941008d1d800 for lustre-MDT0001-mdc-ffff9410107bd800 00000020:00000080:1.0:1767323420.598940:0:8:0:(genops.c:904:class_export_put()) final put ffff941008d1f800/b504cb06-162c-4989-9f96-575f2ee3236b 00000020:00000080:1.0:1767323420.598944:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff941008d1f800/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-MDT0001-mdc-ffff9410107bd800 00000020:01000000:1.0:1767323420.598951:0:8:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdc-ffff9410107bd800 (b504cb06-162c-4989-9f96-575f2ee3236b) 00000008:01000000:0.0:1767323420.602565:0:127171:0:(obd_class.h:663:obd_cleanup_client_import()) lustre-MDT0000-mdc-ffff9410107bd800: client import never connected 00000100:00080000:0.0:1767323420.602573:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1767323420.602590:0:127171:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410107bd800: committing for last_committed 8589934636 gen 3 00000100:00020000:0.0:1767323420.602596:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup 00000100:00100000:0.0:1767323420.602599:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:0.0:1767323420.602601:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 4 not setup 00000020:00000080:2.0:1767323420.604913:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff941008d1d000 for lustre-MDT0000-mdc-ffff9410107bd800 00000020:00000080:0.0:1767323420.606128:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1767323420.606143:0:127171:0:(obd_config.c:814:class_detach()) detach on obd lustre-MDT0000-mdc-ffff9410107bd800 (uuid b504cb06-162c-4989-9f96-575f2ee3236b) 00000020:00000080:0.0:1767323420.606148:0:127171:0:(genops.c:904:class_export_put()) final put ffff941008d18000/b504cb06-162c-4989-9f96-575f2ee3236b 00000020:00000080:0.0:1767323420.606151:0:127171:0:(genops.c:863:class_export_destroy()) destroying export ffff941008d18000/b504cb06-162c-4989-9f96-575f2ee3236b for lustre-MDT0000-mdc-ffff9410107bd800 00000020:01000000:0.0:1767323420.606156:0:127171:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdc-ffff9410107bd800 (b504cb06-162c-4989-9f96-575f2ee3236b) 00000080:02000400:0.0:1767323420.631756:0:127171:0:(llite_lib.c:1613:ll_put_super()) Unmounted lustre-client 00000020:01000000:0.0:1767323420.634909:0:127171:0:(obd_config.c:1123:class_del_profile()) Del profile lustre-client 00000020:01000004:0.0:1767323420.635249:0:127171:0:(obd_mount.c:875:lustre_common_put_super()) dropping sb ffff9410107bd800 00000100:00080000:0.0:1767323420.635259:0:127171:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import a580d111-beb0-40eb-baf8-9c6ae51ee68f->MGS 00010000:00010000:0.0:1767323420.635284:0:127171:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff9410014a2000/0x720c8b170b5566ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6f7fea81d46fda0a expref: -99 pid: 125432 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1767323420.635297:0:127171:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff9410014a2000/0x720c8b170b5566ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6f7fea81d46fda0a expref: -99 pid: 125432 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1767323420.635303:0:127171:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1767323420.635306:0:127171:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1767323420.635309:0:127171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1767323420.635355:0:127171:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff9410014a2000/0x720c8b170b5566ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda0a expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323420.635362:0:127171:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1767323420.635571:0:127171:0:(client.c:2690:ptlrpc_set_wait()) set ffff941039530840 going to sleep for 0 seconds 00000100:00100000:0.0:1767323420.635584:0:127171:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job umount:a580d111-beb0-40eb-baf8-9c6ae51ee68f:127171:1853171975833472:192.168.204.130@tcp:103:umount.0 00010000:00010000:0.0:1767323420.635594:0:127171:0:(ldlm_request.c:1494:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1767323420.635603:0:127171:0:(ldlm_request.c:2263:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1767323420.635607:0:127171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff9410014a2000/0x720c8b170b5566ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6f7fea81d46fda0a expref: -99 pid: 125432 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1767323420.635645:0:127171:0:(import.c:65:import_set_state_nolock()) ffff9410201a8000 MGS: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1767323420.635761:0:111000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111000:1853171975833600:192.168.204.130@tcp:251:umount.0 00000100:00080000:0.0:1767323420.638200:0:111000:0:(import.c:65:import_set_state_nolock()) ffff9410201a8000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1767323420.638210:0:111000:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1767323420.638213:0:111000:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1767323420.638214:0:111000:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1767323420.638225:0:111000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a580d111-beb0-40eb-baf8-9c6ae51ee68f:111000:1853171975833600:192.168.204.130@tcp:251:umount.0 00000100:00080000:1.0:1767323420.638325:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1767323420.638329:0:127171:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1767323420.638332:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1767323420.638334:0:127171:0:(mgc_request.c:1165:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1767323420.638344:0:127171:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x720c8b170b5566e6 00000020:00000080:1.0:1767323420.638352:0:127171:0:(genops.c:904:class_export_put()) final put ffff9410201af800/a580d111-beb0-40eb-baf8-9c6ae51ee68f 00000020:01000000:1.0:1767323420.638374:0:127171:0:(obd_config.c:2361:class_manual_cleanup()) Manual cleanup of MGC192.168.204.130@tcp (flags='') 00000020:00000080:3.0:1767323420.638494:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff9410201af800/a580d111-beb0-40eb-baf8-9c6ae51ee68f for MGC192.168.204.130@tcp 00000020:00000080:1.0:1767323420.638588:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1767323420.638643:0:127171:0:(obd_config.c:886:class_cleanup()) MGC192.168.204.130@tcp: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1767323420.638648:0:127171:0:(genops.c:1575:class_disconnect_exports()) OBD device 0 (ffff941005b58000) has no exports 10000000:01000000:1.0:1767323420.638728:0:125441:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1767323420.638867:0:127171:0:(obd_class.h:663:obd_cleanup_client_import()) MGC192.168.204.130@tcp: client import never connected 00000100:00080000:3.0:1767323420.638870:0:127171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00020000:3.0:1767323420.638872:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup 00000100:00100000:3.0:1767323420.638874:0:127171:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00020000:3.0:1767323420.638877:0:127171:0:(obd_class.h:479:obd_check_dev()) Device 0 not setup 00000020:00000080:3.0:1767323420.638941:0:127171:0:(obd_config.c:1389:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1767323420.638948:0:127171:0:(obd_config.c:814:class_detach()) detach on obd MGC192.168.204.130@tcp (uuid a580d111-beb0-40eb-baf8-9c6ae51ee68f) 00000020:01000004:3.0:1767323420.638953:0:127171:0:(obd_mount.c:705:lustre_put_lsi()) put ffff9410107bd800 1 00000020:01000004:3.0:1767323420.638957:0:127171:0:(obd_mount.c:637:lustre_free_lsi()) Freeing lsi ffff9410107b9000 00000020:00000080:0.0:1767323420.639215:0:8:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff9410201a8000 for MGC192.168.204.130@tcp 00000020:00000080:0.0:1767323420.639222:0:8:0:(genops.c:904:class_export_put()) final put ffff9410107ba800/a580d111-beb0-40eb-baf8-9c6ae51ee68f 00000020:00000080:0.0:1767323420.639224:0:8:0:(genops.c:863:class_export_destroy()) destroying export ffff9410107ba800/a580d111-beb0-40eb-baf8-9c6ae51ee68f for MGC192.168.204.130@tcp 00000020:01000000:0.0:1767323420.639233:0:8:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGC192.168.204.130@tcp (a580d111-beb0-40eb-baf8-9c6ae51ee68f) 00010000:00010000:1.0:1767323420.640339:0:125438:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1767323420.640752:0:125439:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1767323420.640930:0:125434:0:(service.c:3155:ptlrpc_main()) ldlm_cb00_001: service thread [ffff94100776dc00:125434] 1 exiting: rc = 0 00000100:00100000:3.0:1767323420.641083:0:125433:0:(service.c:3155:ptlrpc_main()) ldlm_cb00_000: service thread [ffff94100776ca00:125433] 0 exiting: rc = 1 00000100:00100000:0.0:1767323420.641342:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1767323420.641727:0:125436:0:(service.c:3155:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9410042dc400:125436] 1 exiting: rc = 0 00000100:00100000:1.0:1767323420.641777:0:125435:0:(service.c:3155:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9410042dd400:125435] 0 exiting: rc = 1 00000100:00100000:3.0:1767323420.642092:0:125437:0:(service.c:3155:ptlrpc_main()) ldlm_cn00_002: service thread [ffff941018aab400:125437] 2 exiting: rc = 0 00000100:00100000:0.0:1767323420.642334:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642342:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642347:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642352:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642358:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642365:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642371:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642376:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642552:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642561:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642566:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642572:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642577:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642583:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642589:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642594:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642599:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642604:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642625:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642631:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642636:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642641:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642646:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642651:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642657:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642662:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642667:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642672:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642678:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642684:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642690:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642695:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642701:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642706:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642711:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642717:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642722:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642727:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642732:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642737:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642742:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642747:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642751:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642757:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642764:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642771:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642777:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642784:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642880:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642887:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642893:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642899:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642905:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642918:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642923:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642929:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642935:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642942:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642948:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642953:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642958:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642963:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642968:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1767323420.642973:0:8:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000010:3.0:1767323547.860214:0:130258:0:(obd_mount.c:609:lustre_init_lsi()) kmalloced '(lsi)': 1880 at ffff9410201ad000. 00000020:00000010:3.0:1767323547.860227:0:130258:0:(obd_mount.c:612:lustre_init_lsi()) kmalloced '(lsi->lsi_lmd)': 120 at ffff9410394b7000. 00000020:00000010:3.0:1767323547.860239:0:130258:0:(obd_mount.c:1344:lmd_parse()) kmalloced '(lmd->lmd_params)': 4096 at ffff941006155000. 00000020:00000010:3.0:1767323547.860252:0:130258:0:(obd_mount.c:1544:lmd_parse()) kmalloced '(lmd->lmd_dev)': 28 at ffff94103b6236e0. 00000020:00000010:3.0:1767323547.860258:0:130258:0:(obd_mount.c:1600:lmd_parse()) kmalloced '(lmd->lmd_profile)': 14 at ffff9410189224c0. 00000020:00000010:3.0:1767323547.860262:0:130258:0:(obd_mount.c:1628:lmd_parse()) kmalloced '(lmd->lmd_opts)': 17 at ffff94103b623680. 00000020:00000010:3.0:1767323547.860283:0:130258:0:(obd_mount.c:322:lustre_start_mgc()) kmalloced '(mgcname)': 23 at ffff94103b623c00. 00000020:00000010:3.0:1767323547.860288:0:130258:0:(obd_mount.c:330:lustre_start_mgc()) kmalloced '(data)': 192 at ffff941005b7a300. 00000020:00000010:3.0:1767323547.860299:0:130258:0:(obd_mount.c:151:do_lcfg()) kmalloced '(lcfg)': 88 at ffff9410399073c0. 00000100:00000010:3.0:1767323547.860308:0:130258:0:(lustre_peer.c:71:class_add_uuid()) kmalloced '(data)': 704 at ffff941005976000. 00000400:00000200:3.0:1767323547.860314:0:130258:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:3.0:1767323547.860319:0:130258:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:3.0:1767323547.860330:0:130258:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:3.0:1767323547.860341:0:130258:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:3.0:1767323547.860344:0:130258:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:3.0:1767323547.860348:0:130258:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 00000100:00000010:3.0:1767323547.860351:0:130258:0:(lustre_peer.c:113:class_add_uuid()) kfreed 'data': 704 at ffff941005976000. 00000020:00000010:3.0:1767323547.860355:0:130258:0:(obd_mount.c:157:do_lcfg()) kfreed 'lcfg': 88 at ffff9410399073c0. 00000020:00000010:3.0:1767323547.860360:0:130258:0:(obd_mount.c:464:lustre_start_mgc()) kmalloced '(uuid)': 40 at ffff94100769ae00. 00000020:00000010:3.0:1767323547.860369:0:130258:0:(obd_mount.c:151:do_lcfg()) kmalloced '(lcfg)': 120 at ffff9410394b7080. 00000020:00000010:3.0:1767323547.860435:0:130258:0:(genops.c:51:obd_device_alloc()) slab-alloced 'obd': 6360 at ffff9410396fb1b0. 00000020:00000010:3.0:1767323547.860455:0:130258:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff9410201a9000. 00000020:00000010:3.0:1767323547.860470:0:130258:0:(obd_mount.c:157:do_lcfg()) kfreed 'lcfg': 120 at ffff9410394b7080. 00000020:00000010:3.0:1767323547.860474:0:130258:0:(obd_mount.c:151:do_lcfg()) kmalloced '(lcfg)': 104 at ffff9410394b7080. 00000001:00000010:3.0:1767323547.860496:0:130258:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941010a67e00. 00000001:00000010:3.0:1767323547.860503:0:130258:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff94103b623880. 00000001:00000010:3.0:1767323547.860508:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941009992400. 00000001:00000010:3.0:1767323547.860511:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941009992800. 00000001:00000010:3.0:1767323547.860514:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941009993c00. 00000001:00000010:3.0:1767323547.860517:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941009992e00. 00000001:00000010:3.0:1767323547.860520:0:130258:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941010a67600. 00000001:00000010:3.0:1767323547.860523:0:130258:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff94103b623460. 00000001:00000010:3.0:1767323547.860526:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941009993600. 00000001:00000010:3.0:1767323547.860529:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941009993400. 00000001:00000010:3.0:1767323547.860531:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941009992200. 00000001:00000010:3.0:1767323547.860534:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941009992a00. 00000020:00000010:3.0:1767323547.860540:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941009993200. 00000020:00000010:3.0:1767323547.860546:0:130258:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff9410394b7800. 00000020:00000010:3.0:1767323547.860553:0:130258:0:(tgt_main.c:756:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff9410395e0ed8. 00008000:00000010:3.0:1767323547.860560:0:130258:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at ffff941005bea0d8. 00000020:00000010:3.0:1767323547.860566:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941009993a00. 00000020:00000010:3.0:1767323547.860571:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff9410088ac200. 00000040:00000010:3.0:1767323547.860576:0:130258:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff9410088ac600. 00000020:00000010:3.0:1767323547.860582:0:130258:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410201a9800. 00000020:00000010:3.0:1767323547.860588:0:130258:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff9410088ace00. 00040000:00000010:3.0:1767323547.860594:0:130258:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941010a67c00. 00040000:00000010:3.0:1767323547.860599:0:130258:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff9410088ada00. 10000000:00000010:3.0:1767323547.860603:0:130258:0:(mgc_request.c:852:mgc_device_alloc()) kmalloced '(lu)': 64 at ffff94100769a780. 00010000:00000010:3.0:1767323547.860615:0:130258:0:(ldlm_lib.c:421:client_obd_setup()) kmalloced '(cli->cl_read_io_latency_by_size)': 3920 at ffff941006153000. 00010000:00000010:3.0:1767323547.860622:0:130258:0:(ldlm_lib.c:434:client_obd_setup()) kmalloced '(cli->cl_write_io_latency_by_size)': 3920 at ffff941006157000. 00010000:00000010:3.0:1767323547.860631:0:130258:0:(ldlm_lockd.c:3355:ldlm_setup()) kmalloced '(ldlm_state)': 32 at ffff94103b623b20. 00000100:00000010:3.0:1767323547.860750:0:130258:0:(service.c:745:ptlrpc_register_service()) kmalloced '(service)': 352 at ffff9410088adc00. 00000100:00000010:3.0:1767323547.860763:0:130258:0:(service.c:803:ptlrpc_register_service()) kmalloced '(svcpt)': 784 at ffff941005974c00. 00000100:00000010:3.0:1767323547.860781:0:130258:0:(service.c:627:ptlrpc_service_part_init()) kmalloced '(array->paa_reqs_array)': 12080 at ffff941011b08000. 00000100:00000010:3.0:1767323547.860790:0:130258:0:(service.c:635:ptlrpc_service_part_init()) kmalloced '(array->paa_reqs_count)': 3020 at ffff941006156000. 00000100:00000010:3.0:1767323547.860797:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005975800. 00000100:00000010:3.0:1767323547.860804:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410059ca000. 00000400:00000200:3.0:1767323547.860809:0:130258:0:(lib-ptl.c:921:LNetSetLazyPortal()) Setting portal 15 lazy 00000020:00000010:3.0:1767323547.860849:0:130258:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941005975c00. 00000020:00000010:3.0:1767323547.860855:0:130258:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff941006150000. 00000100:00000010:3.0:1767323547.860902:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff941005b7acc0. 00000100:00000010:3.0:1767323547.860910:0:130258:0:(nrs_fifo.c:59:nrs_fifo_start()) kmalloced '(head)': 40 at ffff94100769a000. 00000100:00000010:3.0:1767323547.860915:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff941005b7ac00. 00000100:00000010:3.0:1767323547.860919:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff941005b7a480. 00000100:00000010:3.0:1767323547.860934:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff941005b7a900. 00000100:00000200:3.0:1767323547.860975:0:130258:0:(service.c:847:ptlrpc_register_service()) ldlm_cbd: Started, listening on portal 15 00000100:00000010:3.0:1767323547.860981:0:130258:0:(service.c:3445:ptlrpc_start_thread()) kmalloced '(thread)': 328 at ffff9410088ac400. 00000100:00000010:2.0:1767323547.864582:0:130259:0:(service.c:3018:ptlrpc_main()) kmalloced '(env)': 56 at ffff941010bef600. 00000020:00000010:2.0:1767323547.864595:0:130259:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff941010befa40. 00000020:00000010:2.0:1767323547.864839:0:130259:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9410042dca00. 00000020:00000010:2.0:1767323547.864845:0:130259:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff9410042dc400. 00000040:00000010:2.0:1767323547.864850:0:130259:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff9410042dd200. 00000020:00000010:2.0:1767323547.864857:0:130259:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff941010cdf800. 00000020:00000010:2.0:1767323547.864863:0:130259:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff941010988000. 00000020:00000010:2.0:1767323547.864869:0:130259:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff9410042dc600. 80000000:00000010:2.0:1767323547.864994:0:130259:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941011abb660. 40000000:00000010:2.0:1767323547.864999:0:130259:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff941010befd80. 00100000:00000010:2.0:1767323547.865005:0:130259:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff941010cdd000. 00040000:00000010:2.0:1767323547.865010:0:130259:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941018029f00. 00040000:00000010:2.0:1767323547.865014:0:130259:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff941010cda000. 00040000:00000010:2.0:1767323547.865018:0:130259:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff9410042dcc00. 00000004:00000010:2.0:1767323547.865024:0:130259:0:(mdd_device.c:2406:mdd_key_init()) kmalloced '(value)': 1872 at ffff941010cdd800. 00000004:00000010:2.0:1767323547.865031:0:130259:0:(mdt_handler.c:8363:mdt_key_init()) kmalloced '(value)': 2568 at ffff941039b8e000. 00000004:00000010:2.0:1767323547.865037:0:130259:0:(lod_dev.c:2338:lod_key_init()) kmalloced '(value)': 1224 at ffff941010cd9000. 00002000:00000010:2.0:1767323547.865042:0:130259:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff94100736f400. 00000004:00000010:2.0:1767323547.865047:0:130259:0:(osp_dev.c:1816:osp_key_init()) kmalloced '(value)': 616 at ffff94100736ec00. 00000100:00000200:2.0:1767323547.865054:0:130259:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_cbd: registering portal 15 00000400:00000010:2.0:1767323547.865063:0:130259:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c420. 00000400:00000010:2.0:1767323547.865080:0:130259:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94100a633c00. 00000100:00000010:2.0:1767323547.865093:0:130259:0:(service.c:3045:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff941010cd8000. 00000100:00000200:2.0:1767323547.865441:0:130259:0:(service.c:3079:ptlrpc_main()) service thread 0 (#1) started 00000100:00000010:3.0:1767323547.865537:0:130258:0:(service.c:3445:ptlrpc_start_thread()) kmalloced '(thread)': 328 at ffff9410088ad800. 00000100:00000010:2.0:1767323547.871439:0:130260:0:(service.c:3018:ptlrpc_main()) kmalloced '(env)': 56 at ffff941010bef640. 00000020:00000010:2.0:1767323547.871456:0:130260:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff941010beffc0. 00000020:00000010:2.0:1767323547.871464:0:130260:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9410042dda00. 00000020:00000010:2.0:1767323547.871471:0:130260:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff9410042dc800. 00000040:00000010:2.0:1767323547.871487:0:130260:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff9410042dd800. 00000020:00000010:2.0:1767323547.871493:0:130260:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff94100a3e2000. 00000020:00000010:2.0:1767323547.871500:0:130260:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff941010989420. 00000020:00000010:2.0:1767323547.871505:0:130260:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff9410042ddc00. 80000000:00000010:2.0:1767323547.871509:0:130260:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941011abb5a0. 40000000:00000010:2.0:1767323547.871513:0:130260:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff941010bef000. 00100000:00000010:2.0:1767323547.871519:0:130260:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff94100a3e2800. 00040000:00000010:2.0:1767323547.871525:0:130260:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941018029000. 00040000:00000010:2.0:1767323547.871531:0:130260:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff94100a3e7800. 00040000:00000010:2.0:1767323547.871535:0:130260:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff9410042dd400. 00000004:00000010:2.0:1767323547.871542:0:130260:0:(mdd_device.c:2406:mdd_key_init()) kmalloced '(value)': 1872 at ffff941012c89000. 00000004:00000010:2.0:1767323547.871549:0:130260:0:(mdt_handler.c:8363:mdt_key_init()) kmalloced '(value)': 2568 at ffff941039b8d000. 00000004:00000010:2.0:1767323547.871555:0:130260:0:(lod_dev.c:2338:lod_key_init()) kmalloced '(value)': 1224 at ffff9410041c4000. 00002000:00000010:2.0:1767323547.871560:0:130260:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff94100736e400. 00000004:00000010:2.0:1767323547.871583:0:130260:0:(osp_dev.c:1816:osp_key_init()) kmalloced '(value)': 616 at ffff94100736dc00. 00000100:00000010:2.0:1767323547.871590:0:130260:0:(service.c:3045:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff9410041c7000. 00000100:00000200:2.0:1767323547.871614:0:130260:0:(service.c:3079:ptlrpc_main()) service thread 1 (#2) started 00000100:00000010:3.0:1767323547.872046:0:130258:0:(service.c:745:ptlrpc_register_service()) kmalloced '(service)': 352 at ffff9410088ad600. 00000100:00000010:3.0:1767323547.872056:0:130258:0:(service.c:803:ptlrpc_register_service()) kmalloced '(svcpt)': 784 at ffff941005974400. 00000100:00000010:3.0:1767323547.872079:0:130258:0:(service.c:627:ptlrpc_service_part_init()) kmalloced '(array->paa_reqs_array)': 12080 at ffff941007ba4000. 00000100:00000010:3.0:1767323547.872088:0:130258:0:(service.c:635:ptlrpc_service_part_init()) kmalloced '(array->paa_reqs_count)': 3020 at ffff941006151000. 00000100:00000010:3.0:1767323547.872095:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005974000. 00000100:00000010:3.0:1767323547.872103:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410059cc000. 00000100:00000010:3.0:1767323547.872106:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005976c00. 00000100:00000010:3.0:1767323547.872112:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410059c8000. 00000100:00000010:3.0:1767323547.872115:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005974800. 00000100:00000010:3.0:1767323547.872120:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410059ce000. 00000100:00000010:3.0:1767323547.872123:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005976400. 00000100:00000010:3.0:1767323547.872131:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410041a0000. 00000100:00000010:3.0:1767323547.872135:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005975400. 00000100:00000010:3.0:1767323547.872140:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410041a2000. 00000100:00000010:3.0:1767323547.872143:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005977400. 00000100:00000010:3.0:1767323547.872154:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410041a6000. 00000100:00000010:3.0:1767323547.872157:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005976800. 00000100:00000010:3.0:1767323547.872163:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410041a4000. 00000100:00000010:3.0:1767323547.872166:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941005977c00. 00000100:00000010:3.0:1767323547.872172:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410097f0000. 00000100:00000010:3.0:1767323547.872176:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fd9800. 00000100:00000010:3.0:1767323547.872182:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410097f6000. 00000100:00000010:3.0:1767323547.872185:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fda800. 00000100:00000010:3.0:1767323547.872190:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410097f4000. 00000100:00000010:3.0:1767323547.872193:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fdb800. 00000100:00000010:3.0:1767323547.872198:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410097f2000. 00000100:00000010:3.0:1767323547.872201:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fd8800. 00000100:00000010:3.0:1767323547.872206:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941010a78000. 00000100:00000010:3.0:1767323547.872209:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fda000. 00000100:00000010:3.0:1767323547.872214:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941010a7a000. 00000100:00000010:3.0:1767323547.872217:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fdbc00. 00000100:00000010:3.0:1767323547.872222:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941010a7c000. 00000100:00000010:3.0:1767323547.872225:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fd9c00. 00000100:00000010:3.0:1767323547.872229:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941010a7e000. 00000100:00000010:3.0:1767323547.872232:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fda400. 00000100:00000010:3.0:1767323547.872238:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94100578e000. 00000100:00000010:3.0:1767323547.872241:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fdb000. 00000100:00000010:3.0:1767323547.872247:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941005788000. 00000100:00000010:3.0:1767323547.872250:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fd9400. 00000100:00000010:3.0:1767323547.872254:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94100578a000. 00000100:00000010:3.0:1767323547.872257:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fd9000. 00000100:00000010:3.0:1767323547.872263:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94100578c000. 00000100:00000010:3.0:1767323547.872266:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fd8c00. 00000100:00000010:3.0:1767323547.872272:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101828e000. 00000100:00000010:3.0:1767323547.872275:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941039fd8400. 00000100:00000010:3.0:1767323547.872280:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941018288000. 00000100:00000010:3.0:1767323547.872288:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941008f7e000. 00000100:00000010:3.0:1767323547.872294:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101828a000. 00000100:00000010:3.0:1767323547.872298:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941008f7d400. 00000100:00000010:3.0:1767323547.872303:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101828c000. 00000100:00000010:3.0:1767323547.872307:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941004d5e800. 00000100:00000010:3.0:1767323547.872313:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941039ec0000. 00000100:00000010:3.0:1767323547.872316:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941004d5c800. 00000100:00000010:3.0:1767323547.872322:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941039ec4000. 00000100:00000010:3.0:1767323547.872324:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941004d5c400. 00000100:00000010:3.0:1767323547.872330:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941039ec2000. 00000100:00000010:3.0:1767323547.872333:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941004d5dc00. 00000100:00000010:3.0:1767323547.872338:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941039ec6000. 00000100:00000010:3.0:1767323547.872341:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941004d5e400. 00000100:00000010:3.0:1767323547.872347:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941006ce6000. 00000100:00000010:3.0:1767323547.872350:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941004d5f400. 00000100:00000010:3.0:1767323547.872356:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941006ce4000. 00000100:00000010:3.0:1767323547.872359:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941004d5ec00. 00000100:00000010:3.0:1767323547.872364:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941006ce2000. 00000100:00000010:3.0:1767323547.872368:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941042077800. 00000100:00000010:3.0:1767323547.872374:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410078ba000. 00000100:00000010:3.0:1767323547.872377:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941042077400. 00000100:00000010:3.0:1767323547.872399:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941039652000. 00000100:00000010:3.0:1767323547.872403:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941042076400. 00000100:00000010:3.0:1767323547.872408:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941039650000. 00000100:00000010:3.0:1767323547.872412:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941042074400. 00000100:00000010:3.0:1767323547.872418:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941039656000. 00000100:00000010:3.0:1767323547.872424:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100a637000. 00000100:00000010:3.0:1767323547.873035:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94100731a000. 00000100:00000010:2.0:1767323547.873592:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100736f000. 00000100:00000010:2.0:1767323547.873601:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941006d1c000. 00000100:00000010:2.0:1767323547.873605:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100736d800. 00000100:00000010:2.0:1767323547.873611:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941006d1e000. 00000100:00000010:2.0:1767323547.873615:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100736c000. 00000100:00000010:2.0:1767323547.873620:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941006d18000. 00000100:00000010:2.0:1767323547.873624:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100736e800. 00000100:00000010:2.0:1767323547.873629:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941006d1a000. 00000100:00000010:2.0:1767323547.873632:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100736d400. 00000100:00000010:2.0:1767323547.873649:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94100794c000. 00000100:00000010:2.0:1767323547.873653:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100736cc00. 00000100:00000010:2.0:1767323547.873658:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94100794a000. 00000100:00000010:2.0:1767323547.873661:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100736fc00. 00000100:00000010:2.0:1767323547.873666:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941007948000. 00000100:00000010:2.0:1767323547.873669:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff94100736f800. 00000100:00000010:2.0:1767323547.873674:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94100794e000. 00000100:00000010:2.0:1767323547.873678:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010794400. 00000100:00000010:2.0:1767323547.873688:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410108d8000. 00000100:00000010:2.0:1767323547.873692:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010794800. 00000100:00000010:2.0:1767323547.873696:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410108de000. 00000100:00000010:2.0:1767323547.873699:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010796400. 00000100:00000010:2.0:1767323547.873704:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410108dc000. 00000100:00000010:2.0:1767323547.873708:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010796800. 00000100:00000010:2.0:1767323547.873713:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410108da000. 00000100:00000010:2.0:1767323547.873716:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010795400. 00000100:00000010:2.0:1767323547.873726:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410394a8000. 00000100:00000010:2.0:1767323547.873729:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010796c00. 00000100:00000010:2.0:1767323547.873734:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410394ae000. 00000100:00000010:2.0:1767323547.873737:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010795000. 00000100:00000010:2.0:1767323547.873748:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410394ac000. 00000100:00000010:2.0:1767323547.873751:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010797800. 00000100:00000010:2.0:1767323547.873757:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff9410394aa000. 00000100:00000010:2.0:1767323547.873760:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010795800. 00000100:00000010:2.0:1767323547.873770:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101831a000. 00000100:00000010:2.0:1767323547.873773:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010796000. 00000100:00000010:2.0:1767323547.873779:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941018318000. 00000100:00000010:2.0:1767323547.873782:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010794c00. 00000100:00000010:2.0:1767323547.873788:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101831e000. 00000100:00000010:2.0:1767323547.873791:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010797000. 00000100:00000010:2.0:1767323547.873796:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101831c000. 00000100:00000010:2.0:1767323547.873799:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941010794000. 00000100:00000010:2.0:1767323547.873810:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101819c000. 00000100:00000010:2.0:1767323547.873814:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941018336400. 00000100:00000010:2.0:1767323547.873819:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101819a000. 00000100:00000010:2.0:1767323547.873821:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941018337c00. 00000100:00000010:2.0:1767323547.873826:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941018198000. 00000100:00000010:2.0:1767323547.873830:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941018337000. 00000100:00000010:2.0:1767323547.873835:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff94101819e000. 00000100:00000010:2.0:1767323547.873838:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941018336000. 00000100:00000010:2.0:1767323547.873848:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941018236000. 00000100:00000010:2.0:1767323547.873852:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941018334000. 00000100:00000010:2.0:1767323547.873857:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941018234000. 00000100:00000010:2.0:1767323547.873861:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941018336c00. 00000100:00000010:2.0:1767323547.873866:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941018232000. 00000100:00000010:2.0:1767323547.873870:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941018334800. 00000100:00000010:2.0:1767323547.873875:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941018230000. 00000100:00000010:2.0:1767323547.873878:0:130258:0:(service.c:65:ptlrpc_alloc_rqbd()) kmalloced '(rqbd)': 968 at ffff941018337400. 00000100:00000010:2.0:1767323547.873890:0:130258:0:(service.c:75:ptlrpc_alloc_rqbd()) kmalloced '(rqbd->rqbd_buffer)': 8192 at ffff941007582000. 00000400:00000200:2.0:1767323547.873897:0:130258:0:(lib-ptl.c:921:LNetSetLazyPortal()) Setting portal 17 lazy 00000020:00000010:2.0:1767323547.873995:0:130258:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941018335400. 00000020:00000010:2.0:1767323547.874007:0:130258:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff941039b8f000. 00000100:00000010:2.0:1767323547.874079:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff94100a633300. 00000100:00000010:2.0:1767323547.874086:0:130258:0:(nrs_fifo.c:59:nrs_fifo_start()) kmalloced '(head)': 40 at ffff941010bef0c0. 00000100:00000010:2.0:1767323547.874091:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff94100a633540. 00000100:00000010:2.0:1767323547.874095:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff94100a633480. 00000100:00000010:2.0:1767323547.874167:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff94100a6330c0. 00000100:00000010:2.0:1767323547.874172:0:130258:0:(nrs.c:1026:nrs_svcpt_setup_locked()) kmalloced '(svcpt->scp_nrs_hp)': 112 at ffff941010b6b480. 00000100:00000010:2.0:1767323547.874175:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff94100a633900. 00000100:00000010:2.0:1767323547.874177:0:130258:0:(nrs_fifo.c:59:nrs_fifo_start()) kmalloced '(head)': 40 at ffff941010bef580. 00000100:00000010:2.0:1767323547.874180:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff94100a633240. 00000100:00000010:2.0:1767323547.874183:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff94100a633cc0. 00000100:00000010:2.0:1767323547.874187:0:130258:0:(nrs.c:794:nrs_policy_register()) kmalloced '(policy)': 152 at ffff941005f96780. 00000100:00000200:2.0:1767323547.874225:0:130258:0:(service.c:847:ptlrpc_register_service()) ldlm_canceld: Started, listening on portal 17 00000100:00000010:2.0:1767323547.874231:0:130258:0:(service.c:3445:ptlrpc_start_thread()) kmalloced '(thread)': 328 at ffff9410042dd000. 00000100:00000010:2.0:1767323547.874753:0:130261:0:(service.c:3018:ptlrpc_main()) kmalloced '(env)': 56 at ffff941010bef900. 00000020:00000010:2.0:1767323547.874759:0:130261:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff941010befdc0. 00000020:00000010:2.0:1767323547.874767:0:130261:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941018a92e00. 00000020:00000010:2.0:1767323547.874771:0:130261:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941018a93800. 00000020:00000010:2.0:1767323547.874776:0:130261:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941011abbe40. 00000040:00000010:2.0:1767323547.874780:0:130261:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff941018a93000. 00000020:00000010:2.0:1767323547.874786:0:130261:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410041c6800. 00000020:00000010:2.0:1767323547.874792:0:130261:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff94101098a840. 00000020:00000010:2.0:1767323547.874797:0:130261:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941018a93200. 80000000:00000010:2.0:1767323547.874802:0:130261:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941011abb000. 40000000:00000010:2.0:1767323547.874806:0:130261:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff941010bef440. 00008000:00000010:2.0:1767323547.874813:0:130261:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff94100437b170. 00100000:00000010:2.0:1767323547.874819:0:130261:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff9410041c3800. 00040000:00000010:2.0:1767323547.874824:0:130261:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941018029700. 00040000:00000010:2.0:1767323547.874829:0:130261:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff9410041c3000. 00040000:00000010:2.0:1767323547.874833:0:130261:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941018a92800. 00000004:00000010:2.0:1767323547.874838:0:130261:0:(mdd_device.c:2406:mdd_key_init()) kmalloced '(value)': 1872 at ffff9410041c6000. 00000004:00000010:2.0:1767323547.874844:0:130261:0:(mdt_handler.c:8363:mdt_key_init()) kmalloced '(value)': 2568 at ffff941039b8a000. 00000004:00000010:2.0:1767323547.874849:0:130261:0:(lod_dev.c:2338:lod_key_init()) kmalloced '(value)': 1224 at ffff9410041c1800. 00002000:00000010:2.0:1767323547.874858:0:130261:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff941018335c00. 00000004:00000010:2.0:1767323547.874863:0:130261:0:(osp_dev.c:1816:osp_key_init()) kmalloced '(value)': 616 at ffff941018335000. 00000100:00000200:2.0:1767323547.874869:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874875:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cc60. 00000400:00000010:2.0:1767323547.874882:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94100a7eb540. 00000100:00000200:2.0:1767323547.874890:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874892:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c840. 00000400:00000010:2.0:1767323547.874895:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941012c7f9c0. 00000100:00000200:2.0:1767323547.874897:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874899:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cb58. 00000400:00000010:2.0:1767323547.874903:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941012c7f6c0. 00000100:00000200:2.0:1767323547.874905:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874908:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c580. 00000400:00000010:2.0:1767323547.874910:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941012c7f0c0. 00000100:00000200:2.0:1767323547.874912:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874914:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778ca50. 00000400:00000010:2.0:1767323547.874918:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941012e39780. 00000100:00000200:2.0:1767323547.874919:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874921:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cec8. 00000400:00000010:2.0:1767323547.874934:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971be40. 00000100:00000200:2.0:1767323547.874936:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874938:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cd68. 00000400:00000010:2.0:1767323547.874941:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971b180. 00000100:00000200:2.0:1767323547.874943:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874945:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c688. 00000400:00000010:2.0:1767323547.874947:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971ba80. 00000100:00000200:2.0:1767323547.874949:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874950:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c630. 00000400:00000010:2.0:1767323547.874953:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971bd80. 00000100:00000200:2.0:1767323547.874955:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874957:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c948. 00000400:00000010:2.0:1767323547.874959:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971b300. 00000100:00000200:2.0:1767323547.874961:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874963:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c478. 00000400:00000010:2.0:1767323547.874965:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971b6c0. 00000100:00000200:2.0:1767323547.874972:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874975:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cf20. 00000400:00000010:2.0:1767323547.874977:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971b240. 00000100:00000200:2.0:1767323547.874979:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874981:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c370. 00000400:00000010:2.0:1767323547.874984:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971b600. 00000100:00000200:2.0:1767323547.874986:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874988:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c790. 00000400:00000010:2.0:1767323547.874990:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971b3c0. 00000100:00000200:2.0:1767323547.874991:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.874993:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cd10. 00000400:00000010:2.0:1767323547.874996:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971bf00. 00000100:00000200:2.0:1767323547.874998:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875000:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c738. 00000400:00000010:2.0:1767323547.875003:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971b900. 00000100:00000200:2.0:1767323547.875005:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875007:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c1b8. 00000400:00000010:2.0:1767323547.875009:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971b0c0. 00000100:00000200:2.0:1767323547.875011:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875013:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778ce70. 00000400:00000010:2.0:1767323547.875016:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103971bb40. 00000100:00000200:2.0:1767323547.875018:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875020:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c210. 00000400:00000010:2.0:1767323547.875023:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101a11c840. 00000100:00000200:2.0:1767323547.875025:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875027:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778caa8. 00000400:00000010:2.0:1767323547.875030:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101a11cf00. 00000100:00000200:2.0:1767323547.875032:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875034:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778ccb8. 00000400:00000010:2.0:1767323547.875036:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101a11c6c0. 00000100:00000200:2.0:1767323547.875038:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875040:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c9a0. 00000400:00000010:2.0:1767323547.875043:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554180. 00000100:00000200:2.0:1767323547.875045:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875047:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cbb0. 00000400:00000010:2.0:1767323547.875054:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554cc0. 00000100:00000200:2.0:1767323547.875056:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875058:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cc08. 00000400:00000010:2.0:1767323547.875061:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554000. 00000100:00000200:2.0:1767323547.875062:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875065:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c108. 00000400:00000010:2.0:1767323547.875067:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554f00. 00000100:00000200:2.0:1767323547.875069:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875071:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778ce18. 00000400:00000010:2.0:1767323547.875073:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554a80. 00000100:00000200:2.0:1767323547.875075:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875078:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c2c0. 00000400:00000010:2.0:1767323547.875080:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554e40. 00000100:00000200:2.0:1767323547.875082:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875085:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c528. 00000400:00000010:2.0:1767323547.875087:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff9410395540c0. 00000100:00000200:2.0:1767323547.875089:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875092:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c8f0. 00000400:00000010:2.0:1767323547.875094:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554c00. 00000100:00000200:2.0:1767323547.875096:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875175:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cf78. 00000400:00000010:2.0:1767323547.875180:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554600. 00000100:00000200:2.0:1767323547.875183:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875185:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c268. 00000400:00000010:2.0:1767323547.875188:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554b40. 00000100:00000200:2.0:1767323547.875190:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875192:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c3c8. 00000400:00000010:2.0:1767323547.875195:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554d80. 00000100:00000200:2.0:1767323547.875197:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875199:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c4d0. 00000400:00000010:2.0:1767323547.875201:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554300. 00000100:00000200:2.0:1767323547.875203:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875205:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c058. 00000400:00000010:2.0:1767323547.875207:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff9410395546c0. 00000100:00000200:2.0:1767323547.875209:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875216:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c318. 00000400:00000010:2.0:1767323547.875219:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554900. 00000100:00000200:2.0:1767323547.875222:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875224:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c160. 00000400:00000010:2.0:1767323547.875226:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554840. 00000100:00000200:2.0:1767323547.875229:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875231:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cdc0. 00000400:00000010:2.0:1767323547.875233:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff9410395543c0. 00000100:00000200:2.0:1767323547.875236:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875238:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c6e0. 00000400:00000010:2.0:1767323547.875240:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff941039554240. 00000100:00000200:2.0:1767323547.875242:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875244:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c5d8. 00000400:00000010:2.0:1767323547.875247:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a240. 00000100:00000200:2.0:1767323547.875249:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875251:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c898. 00000400:00000010:2.0:1767323547.875253:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a180. 00000100:00000200:2.0:1767323547.875255:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875257:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c9f8. 00000400:00000010:2.0:1767323547.875259:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a6c0. 00000100:00000200:2.0:1767323547.875261:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875263:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c7e8. 00000400:00000010:2.0:1767323547.875265:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a300. 00000100:00000200:2.0:1767323547.875268:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875270:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c000. 00000400:00000010:2.0:1767323547.875272:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966af00. 00000100:00000200:2.0:1767323547.875274:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875276:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778c0b0. 00000400:00000010:2.0:1767323547.875278:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a480. 00000100:00000200:2.0:1767323547.875280:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875282:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff94100778cb00. 00000400:00000010:2.0:1767323547.875284:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a600. 00000100:00000200:2.0:1767323547.875286:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875289:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35790. 00000400:00000010:2.0:1767323547.875291:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966ac00. 00000100:00000200:2.0:1767323547.875594:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875599:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a352c0. 00000400:00000010:2.0:1767323547.875603:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a000. 00000100:00000200:2.0:1767323547.875605:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875607:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a354d0. 00000400:00000010:2.0:1767323547.875610:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966ab40. 00000100:00000200:2.0:1767323547.875613:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875615:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35bb0. 00000400:00000010:2.0:1767323547.875618:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966acc0. 00000100:00000200:2.0:1767323547.875620:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875623:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35630. 00000400:00000010:2.0:1767323547.875626:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966ad80. 00000100:00000200:2.0:1767323547.875628:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875630:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35370. 00000400:00000010:2.0:1767323547.875632:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a780. 00000100:00000200:2.0:1767323547.875635:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875637:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35c60. 00000400:00000010:2.0:1767323547.875640:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a3c0. 00000100:00000200:2.0:1767323547.875642:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875644:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35318. 00000400:00000010:2.0:1767323547.875647:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a9c0. 00000100:00000200:2.0:1767323547.875649:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875651:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a357e8. 00000400:00000010:2.0:1767323547.875654:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a840. 00000100:00000200:2.0:1767323547.875656:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875658:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35210. 00000400:00000010:2.0:1767323547.875661:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966a900. 00000100:00000200:2.0:1767323547.875663:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875665:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a355d8. 00000400:00000010:2.0:1767323547.875668:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94103966ae40. 00000100:00000200:2.0:1767323547.875670:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875672:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35160. 00000400:00000010:2.0:1767323547.875679:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94100accf300. 00000100:00000200:2.0:1767323547.875681:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875684:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35cb8. 00000400:00000010:2.0:1767323547.875693:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94100accf480. 00000100:00000200:2.0:1767323547.875695:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875698:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35420. 00000400:00000010:2.0:1767323547.875701:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101094e180. 00000100:00000200:2.0:1767323547.875703:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875706:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35948. 00000400:00000010:2.0:1767323547.875709:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101094ee40. 00000100:00000200:2.0:1767323547.875711:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875713:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35f78. 00000400:00000010:2.0:1767323547.875715:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101094ed80. 00000100:00000200:2.0:1767323547.875717:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875719:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35e18. 00000400:00000010:2.0:1767323547.875721:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101094e780. 00000100:00000200:2.0:1767323547.875723:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875725:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35840. 00000400:00000010:2.0:1767323547.875727:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101094e600. 00000100:00000200:2.0:1767323547.875729:0:130261:0:(niobuf.c:1190:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17 00000400:00000010:2.0:1767323547.875730:0:130261:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35528. 00000400:00000010:2.0:1767323547.875732:0:130261:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at ffff94101094e480. 00000100:00000010:2.0:1767323547.875737:0:130261:0:(service.c:3045:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff9410041c1000. 00000100:00000200:2.0:1767323547.875750:0:130261:0:(service.c:3079:ptlrpc_main()) service thread 0 (#1) started 00000100:00000010:0.0:1767323547.875810:0:130258:0:(service.c:3445:ptlrpc_start_thread()) kmalloced '(thread)': 328 at ffff941011915a00. 00000100:00000010:2.0:1767323547.876330:0:130262:0:(service.c:3018:ptlrpc_main()) kmalloced '(env)': 56 at ffff941010bef980. 00000020:00000010:2.0:1767323547.876336:0:130262:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff941010bef7c0. 00000020:00000010:2.0:1767323547.876342:0:130262:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941009200400. 00000020:00000010:2.0:1767323547.876346:0:130262:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941009200a00. 00000020:00000010:2.0:1767323547.876350:0:130262:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941011abb300. 00000040:00000010:2.0:1767323547.876354:0:130262:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff941009200000. 00000020:00000010:2.0:1767323547.876360:0:130262:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410061a2800. 00000020:00000010:2.0:1767323547.876365:0:130262:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff94101098ad48. 00000020:00000010:2.0:1767323547.876370:0:130262:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941039570000. 80000000:00000010:2.0:1767323547.876373:0:130262:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941011abb060. 40000000:00000010:2.0:1767323547.876377:0:130262:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff941010bef400. 00008000:00000010:2.0:1767323547.876410:0:130262:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff94100437a6d8. 00100000:00000010:2.0:1767323547.876416:0:130262:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff9410061a3000. 00040000:00000010:2.0:1767323547.876420:0:130262:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941018029200. 00040000:00000010:2.0:1767323547.876432:0:130262:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff9410061a0000. 00040000:00000010:2.0:1767323547.876436:0:130262:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941039571400. 00000004:00000010:2.0:1767323547.876441:0:130262:0:(mdd_device.c:2406:mdd_key_init()) kmalloced '(value)': 1872 at ffff9410061a7800. 00000004:00000010:2.0:1767323547.876448:0:130262:0:(mdt_handler.c:8363:mdt_key_init()) kmalloced '(value)': 2568 at ffff9410201b7000. 00000004:00000010:2.0:1767323547.876453:0:130262:0:(lod_dev.c:2338:lod_key_init()) kmalloced '(value)': 1224 at ffff9410061a1000. 00002000:00000010:2.0:1767323547.876458:0:130262:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff941018334c00. 00000004:00000010:2.0:1767323547.876462:0:130262:0:(osp_dev.c:1816:osp_key_init()) kmalloced '(value)': 616 at ffff941018337800. 00000100:00000010:2.0:1767323547.876467:0:130262:0:(service.c:3045:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff9410061a6000. 00000100:00000200:2.0:1767323547.876476:0:130262:0:(service.c:3079:ptlrpc_main()) service thread 1 (#2) started 00000100:00000010:0.0:1767323547.876661:0:130258:0:(service.c:3445:ptlrpc_start_thread()) kmalloced '(thread)': 328 at ffff941011914c00. 00000100:00000010:2.0:1767323547.878022:0:130263:0:(service.c:3018:ptlrpc_main()) kmalloced '(env)': 56 at ffff941010befec0. 00000020:00000010:2.0:1767323547.878029:0:130263:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff941010bef840. 00000020:00000010:2.0:1767323547.878035:0:130263:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941039571c00. 00000020:00000010:2.0:1767323547.878039:0:130263:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941039571a00. 00000020:00000010:2.0:1767323547.878043:0:130263:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941011abbc60. 00000040:00000010:2.0:1767323547.878047:0:130263:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff941039570a00. 00000020:00000010:2.0:1767323547.878052:0:130263:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410061a1800. 00000020:00000010:2.0:1767323547.878058:0:130263:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff94101098c168. 00000020:00000010:2.0:1767323547.878062:0:130263:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941039571800. 80000000:00000010:2.0:1767323547.878066:0:130263:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941011abbde0. 40000000:00000010:2.0:1767323547.878069:0:130263:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff941010bef040. 00008000:00000010:2.0:1767323547.878074:0:130263:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff94100437aa60. 00100000:00000010:2.0:1767323547.878078:0:130263:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff9410061a0800. 00040000:00000010:2.0:1767323547.878083:0:130263:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941018029100. 00040000:00000010:2.0:1767323547.878087:0:130263:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff9410061a5000. 00040000:00000010:2.0:1767323547.878091:0:130263:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941039571200. 00000004:00000010:2.0:1767323547.878174:0:130263:0:(mdd_device.c:2406:mdd_key_init()) kmalloced '(value)': 1872 at ffff9410061a4000. 00000004:00000010:2.0:1767323547.878183:0:130263:0:(mdt_handler.c:8363:mdt_key_init()) kmalloced '(value)': 2568 at ffff9410201b2000. 00000004:00000010:2.0:1767323547.878188:0:130263:0:(lod_dev.c:2338:lod_key_init()) kmalloced '(value)': 1224 at ffff9410061a3800. 00002000:00000010:2.0:1767323547.878194:0:130263:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff941018334400. 00000004:00000010:2.0:1767323547.878201:0:130263:0:(osp_dev.c:1816:osp_key_init()) kmalloced '(value)': 616 at ffff941003e60400. 00000100:00000010:2.0:1767323547.878206:0:130263:0:(service.c:3045:ptlrpc_main()) kmalloced '(rs)': 2048 at ffff9410061a6800. 00000100:00000200:2.0:1767323547.878230:0:130263:0:(service.c:3079:ptlrpc_main()) service thread 2 (#3) started 00010000:00000010:0.0:1767323547.878279:0:130258:0:(ldlm_lockd.c:3465:ldlm_setup()) kmalloced '(blp)': 168 at ffff9410398bd9c0. 00010000:00000010:3.0:1767323547.879410:0:130264:0:(ldlm_lockd.c:2960:ldlm_bl_thread_main()) kmalloced '(env)': 56 at ffff94100769abc0. 00000020:00000010:3.0:1767323547.879418:0:130264:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9410088ac000. 00000020:00000010:3.0:1767323547.879423:0:130264:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff9410088aca00. 00000020:00000010:3.0:1767323547.879436:0:130264:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410201ad800. 00000020:00000010:3.0:1767323547.879514:0:130264:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff9410081778c0. 00000020:00000010:3.0:1767323547.879519:0:130264:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff94100776ca00. 80000000:00000010:3.0:1767323547.879524:0:130264:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941039907420. 40000000:00000010:3.0:1767323547.879528:0:130264:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff94100769af00. 00100000:00000010:3.0:1767323547.879533:0:130264:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff9410201af800. 00040000:00000010:3.0:1767323547.879537:0:130264:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941010a67000. 00040000:00000010:3.0:1767323547.879541:0:130264:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff94100776cc00. 00002000:00000010:3.0:1767323547.879546:0:130264:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff94100a636400. 00000020:00000010:3.0:1767323547.879550:0:130264:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff94100769a800. 00010000:00000010:2.0:1767323547.881097:0:130265:0:(ldlm_lockd.c:2960:ldlm_bl_thread_main()) kmalloced '(env)': 56 at ffff941010bef240. 00000020:00000010:2.0:1767323547.881117:0:130265:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941039570c00. 00000020:00000010:2.0:1767323547.881129:0:130265:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941039571000. 00000020:00000010:2.0:1767323547.881139:0:130265:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff94100a3c6800. 00000020:00000010:2.0:1767323547.881145:0:130265:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff94101098da90. 00000020:00000010:2.0:1767323547.881150:0:130265:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941007301c00. 80000000:00000010:2.0:1767323547.881154:0:130265:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941011abbcc0. 40000000:00000010:2.0:1767323547.881157:0:130265:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff941010bef280. 00100000:00000010:2.0:1767323547.881163:0:130265:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff941010fb8000. 00040000:00000010:2.0:1767323547.881168:0:130265:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941018029c00. 00040000:00000010:2.0:1767323547.881171:0:130265:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941007300c00. 00002000:00000010:2.0:1767323547.881176:0:130265:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff941003e61c00. 00000020:00000010:2.0:1767323547.881182:0:130265:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff941010bef8c0. 00000020:00000010:2.0:1767323547.881688:0:130266:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941007300a00. 00000020:00000010:2.0:1767323547.881693:0:130266:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941007300000. 00000040:00000010:2.0:1767323547.881698:0:130266:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff941007301400. 00000020:00000010:2.0:1767323547.881702:0:130266:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff941010fbc000. 00000020:00000010:2.0:1767323547.881706:0:130266:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff941010989928. 00000020:00000010:2.0:1767323547.881709:0:130266:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941007300400. 80000000:00000010:2.0:1767323547.881712:0:130266:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941011abb900. 40000000:00000010:2.0:1767323547.881715:0:130266:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff941010bef180. 00100000:00000010:2.0:1767323547.881719:0:130266:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff941010fbd000. 00040000:00000010:2.0:1767323547.881722:0:130266:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941018029b00. 00040000:00000010:2.0:1767323547.881729:0:130266:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff941020249800. 00040000:00000010:2.0:1767323547.881733:0:130266:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941007301a00. 00000004:00000010:2.0:1767323547.881738:0:130266:0:(mdd_device.c:2406:mdd_key_init()) kmalloced '(value)': 1872 at ffff94102024e800. 00000004:00000010:2.0:1767323547.881744:0:130266:0:(mdt_handler.c:8363:mdt_key_init()) kmalloced '(value)': 2568 at ffff9410201b0000. 00000004:00000010:2.0:1767323547.881749:0:130266:0:(lod_dev.c:2338:lod_key_init()) kmalloced '(value)': 1224 at ffff94102024d800. 00002000:00000010:2.0:1767323547.881752:0:130266:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff941003e63000. 00000004:00000010:2.0:1767323547.881757:0:130266:0:(osp_dev.c:1816:osp_key_init()) kmalloced '(value)': 616 at ffff941003e61400. 00000020:00000010:2.0:1767323547.881760:0:130266:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff941010befa00. 00000001:00000010:0.0:1767323547.881817:0:130258:0:(shrinker_debug.c:228:ll_shrinker_alloc()) alloc '(s)': 88 at ffff941007ba2360. 00000001:00000010:0.0:1767323547.881831:0:130258:0:(shrinker_debug.c:228:ll_shrinker_alloc()) alloc '(s)': 88 at ffff941007ba2d80. 00000020:00000010:0.0:1767323547.881862:0:130258:0:(genops.c:1281:class_new_import()) kmalloced '(imp)': 1712 at ffff941005ebf000. 00000100:00000200:0.0:1767323547.881959:0:130258:0:(events.c:560:ptlrpc_uuid_to_peer()) 192.168.204.130@tcp->12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323547.881972:0:130258:0:(peer.c:1531:LNetPrimaryNID()) NID 192.168.204.130@tcp primary NID 192.168.204.130@tcp rc 0 00010000:00000010:0.0:1767323547.881980:0:130258:0:(ldlm_lib.c:70:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff941007ba27e0. 00010000:00000010:0.0:1767323547.881987:0:130258:0:(ldlm_resource.c:780:ldlm_namespace_new()) kmalloced '(ns)': 816 at ffff94101090d800. 00000001:00000010:0.0:1767323547.881994:0:130258:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 280 at ffff941011914800. 00000001:00000010:0.0:1767323547.882004:0:130258:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 16 at ffff941018ab5ec0. 00000001:00000010:0.0:1767323547.882009:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 304 at ffff941011914a00. 00000001:00000010:0.0:1767323547.882012:0:130258:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 304 at ffff941011914600. 00000020:00000010:0.0:1767323547.882072:0:130258:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94101090cc00. 00000020:00000010:0.0:1767323547.882077:0:130258:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff941041d91760. 00000020:00000010:0.0:1767323547.882245:0:130258:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94101090f400. 00000020:00000010:0.0:1767323547.882248:0:130258:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff941011915400. 00000040:00000010:0.0:1767323547.882268:0:130258:0:(llog_obd.c:26:llog_new_ctxt()) kmalloced '(ctxt)': 168 at ffff9410398bdd80. 00000020:00000010:0.0:1767323547.889512:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff9410088ac200. 00000040:00000010:0.0:1767323547.889529:0:130258:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff9410088ac600. 00000020:00000010:0.0:1767323547.889533:0:130258:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff9410201a9800. 00000020:00000010:0.0:1767323547.889557:0:130258:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff9410088ace00. 00040000:00000010:0.0:1767323547.889563:0:130258:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 248 at ffff941010a67c00. 00040000:00000010:0.0:1767323547.889569:0:130258:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff9410088ada00. 00000020:00000010:0.0:1767323547.889576:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941009993a00. 00000020:00000010:0.0:1767323547.889583:0:130258:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff9410394b7800. 00000020:00000010:0.0:1767323547.889588:0:130258:0:(tgt_main.c:768:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff9410395e0ed8. 00008000:00000010:0.0:1767323547.889594:0:130258:0:(echo_client.c:449:echo_session_key_fini()) slab-freed '(session)': 8 at ffff941005bea0d8. 00000020:00000010:0.0:1767323547.889598:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941009993200. 00000020:00000010:0.0:1767323547.889606:0:130258:0:(obd_mount.c:157:do_lcfg()) kfreed 'lcfg': 104 at ffff9410394b7080. 00000020:00000010:0.0:1767323547.889625:0:130258:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff941005ebb800. 00000400:00000200:0.0:1767323547.889657:0:130258:0:(peer.c:1581:LNetPeerDiscovered()) Peer NID 192.168.204.130@tcp is discovered: rc = 1 00000100:00000010:0.0:1767323547.889674:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5880. 02000000:00000010:0.0:1767323547.889691:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff94101090e800. 02000000:00000010:2.0:1767323547.889764:0:111000:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff941003e63800. 00000400:00000010:2.0:1767323547.889774:0:111000:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35478. 00000400:00000010:2.0:1767323547.889781:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc36e8. 00000100:00000200:2.0:1767323547.889791:0:111000:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975833728, portal 25 00000400:00000010:2.0:1767323547.889804:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc37f8. 00000100:00000200:2.0:1767323547.889808:0:111000:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 26, xid 1853171975833728, offset 0 00000400:00000200:2.0:1767323547.889816:0:111000:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323547.889831:0:111000:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323547.889838:0:111000:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323547.889843:0:111000:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323547.889847:0:111000:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323547.889850:0:111000:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323547.889855:0:111000:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1431:1431:256:4294967295] 192.168.204.130@tcp LPNI seq info [1431:1431:8:4294967295] 00000400:00000200:2.0:1767323547.889867:0:111000:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323547.889874:0:111000:0:(socklnd_cb.c:1001:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323547.891045:0:111000:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941018029900. 00000800:00000200:2.0:1767323547.891062:0:111000:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323547.891072:0:111000:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323547.891077:0:111000:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941018029900 type 1, nob 616 niov 1 nkiov 1 00000100:00000010:2.0:1767323547.891176:0:111000:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941011abb840. 00000100:00000010:2.0:1767323547.891193:0:111000:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941011abbf00. 00000100:00000010:2.0:1767323547.891199:0:111000:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941011abb120. 00000100:00000010:2.0:1767323547.891204:0:111000:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941011abb180. 00000020:00000010:0.0:1767323547.891278:0:130258:0:(obd_mount.c:538:lustre_start_mgc()) kfreed 'uuid': 40 at ffff94100769ae00. 00000020:00000010:0.0:1767323547.891285:0:130258:0:(obd_mount.c:539:lustre_start_mgc()) kfreed 'data': 192 at ffff941005b7a300. 00000020:00000010:0.0:1767323547.891288:0:130258:0:(obd_mount.c:540:lustre_start_mgc()) kfreed 'mgcname': 23 at ffff94103b623c00. 00000080:00000010:0.0:1767323547.891306:0:130258:0:(llite_lib.c:1395:ll_fill_super()) kmalloced '(cfg)': 88 at ffff941007ba2720. 00000080:00000010:0.0:1767323547.891312:0:130258:0:(llite_lib.c:98:ll_init_sbi()) kmalloced '(sbi)': 1376 at ffff941005eb9800. 00000800:00000200:3.0:1767323547.892630:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323547.892639:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941018029900. 00000400:00000200:3.0:1767323547.892646:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323547.892656:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323547.892666:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc37f8 00000400:00000010:3.0:1767323547.892668:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc37f8. 00000100:00000200:3.0:1767323547.892683:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5880 x1853171975833728/t0(0) o250->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 520/544 e 0 to 0 dl 1767323557 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000010:0.0:1767323547.892899:0:130258:0:(cl_page.c:1380:cl_cache_init()) kmalloced '(cache)': 152 at ffff9410398bd000. 00000080:00000010:0.0:1767323547.892908:0:130258:0:(llite_lib.c:132:ll_init_sbi()) kmalloced '(sbi->ll_foreign_symlink_prefix)': 6 at ffff9410105b9ce0. 00000080:00000010:0.0:1767323547.892912:0:130258:0:(llite_lib.c:139:ll_init_sbi()) kmalloced '(sbi->ll_foreign_symlink_upcall)': 5 at ffff9410105b9dd8. 00000020:00000010:0.0:1767323547.893408:0:130258:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94101090f000. 00000020:00000010:0.0:1767323547.893415:0:130258:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 1440 at ffff941005ebd000. 00000020:00000010:0.0:1767323547.893439:0:130258:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94101090fc00. 00000020:00000010:0.0:1767323547.893442:0:130258:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 576 at ffff94101090dc00. 00000020:00000010:0.0:1767323547.893456:0:130258:0:(obd_mount.c:65:lustre_process_log()) kmalloced '(bufs)': 104 at ffff941011b40080. 00000020:00000010:0.0:1767323547.893461:0:130258:0:(obd_mount.c:74:lustre_process_log()) kmalloced '(lcfg)': 184 at ffff9410398bdf00. 00000020:00000010:0.0:1767323547.893467:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941009993200. 00000020:00000010:0.0:1767323547.893472:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941009993a00. 00000040:00000010:0.0:1767323547.893478:0:130258:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff9410088ada00. 00000020:00000010:0.0:1767323547.893484:0:130258:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff941005eba000. 00000020:00000010:0.0:1767323547.893488:0:130258:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff9410088ace00. 00040000:00000010:0.0:1767323547.893505:0:130258:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941010ce9700. 00040000:00000010:0.0:1767323547.893510:0:130258:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff9410088ac600. 10000000:00000010:0.0:1767323547.893522:0:130258:0:(mgc_request.c:197:do_config_log_add()) kmalloced '(cld)': 287 at ffff9410088ac200. 02000000:00000010:0.0:1767323547.893531:0:130258:0:(sec_config.c:546:sptlrpc_conf_get()) kmalloced '(conf)': 120 at ffff941011b40f00. 00000100:00000010:0.0:1767323547.893540:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6d80. 02000000:00000010:0.0:1767323547.893556:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff941006171000. 00010000:00000010:0.0:1767323547.893576:0:130258:0:(ldlm_resource.c:1286:ldlm_resource_new()) slab-alloced 'res': 248 at ffff94102007f600. 00010000:00000010:0.0:1767323547.893585:0:130258:0:(ldlm_lock.c:433:ldlm_lock_new()) slab-alloced 'lock': 512 at ffff941010aef600. 00000020:00000010:0.0:1767323547.893591:0:130258:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 64 at ffff9410395e16c0. 00000100:00000010:0.0:1767323547.893611:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff9410398bd900. 00000400:00000200:0.0:1767323547.896785:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323547.896814:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 416 into portal 25 MB=0x695733953c880 00000400:00000200:0.0:1767323547.896827:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 416/416 into md 0x2ec1 [1] + 0 00000400:00000200:0.0:1767323547.896848:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.896854:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323547.896872:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5880 x1853171975833728/t0(0) o250->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 520/544 e 0 to 0 dl 1767323557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323547.902644:0:111000:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35478. 00000400:00000200:1.0:1767323547.902662:0:111000:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc36e8 00000400:00000010:1.0:1767323547.902665:0:111000:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc36e8. 00000100:00000200:1.0:1767323547.902687:0:111000:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5880 x1853171975833728/t0(0) o250->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 520/544 e 0 to 0 dl 1767323557 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323547.902702:0:111000:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5880 x1853171975833728/t0(0) o250->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 520/544 e 0 to 0 dl 1767323557 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 02000000:00000010:1.0:1767323547.902812:0:111000:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff941003e63800. 02000000:00000010:1.0:1767323547.902821:0:111000:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at ffff94101090e800. 00000100:00000010:1.0:1767323547.902846:0:111000:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5880. 02000000:00000010:3.0:1767323547.903248:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff94100a637400. 00000400:00000010:3.0:1767323547.903259:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328b00. 00000400:00000010:3.0:1767323547.903268:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec880. 00000100:00000200:3.0:1767323547.903277:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975833856, portal 25 00000400:00000010:3.0:1767323547.903284:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec440. 00000100:00000200:3.0:1767323547.903288:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1853171975833856, offset 0 00000400:00000200:3.0:1767323547.903298:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323547.903315:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323547.903323:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323547.903328:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323547.903333:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323547.903336:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323547.903340:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1432:1432:256:4294967295] 192.168.204.130@tcp LPNI seq info [1432:1432:8:4294967295] 00000400:00000200:3.0:1767323547.903354:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323547.903370:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 328 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323547.903376:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941010a67500. 00000800:00000200:3.0:1767323547.903428:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323547.903438:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323547.903444:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941010a67500 type 1, nob 424 niov 1 nkiov 1 00000800:00000200:1.0:1767323547.903784:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323547.903790:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941010a67500. 00000400:00000200:1.0:1767323547.903796:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323547.903803:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323547.903809:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec440 00000400:00000010:1.0:1767323547.903810:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec440. 00000100:00000200:1.0:1767323547.903818:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6d80 x1853171975833856/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1767323547.905372:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323547.905543:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 344 into portal 25 MB=0x695733953c900 00000400:00000200:3.0:1767323547.905554:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 344/344 into md 0x2ec9 [1] + 224 00000400:00000200:3.0:1767323547.905573:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323547.905577:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:3.0:1767323547.905590:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6d80 x1853171975833856/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323547.908960:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328b00. 00000400:00000200:1.0:1767323547.908976:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec880 00000400:00000010:1.0:1767323547.908979:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec880. 00000100:00000200:1.0:1767323547.908998:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6d80 x1853171975833856/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323547.909011:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6d80 x1853171975833856/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1767323547.909044:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff9410398bd900. 02000000:00000010:1.0:1767323547.909076:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff94100a637400. 02000000:00000010:1.0:1767323547.909084:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff941006171000. 00000100:00000010:1.0:1767323547.909090:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6d80. 10000000:00000010:1.0:1767323547.909105:0:130258:0:(mgc_request.c:1693:mgc_process_cfg_log()) kmalloced '(env)': 56 at ffff9410081d1080. 00000020:00000010:1.0:1767323547.909111:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941010710600. 00000020:00000010:1.0:1767323547.909117:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941010711c00. 00000040:00000010:1.0:1767323547.909122:0:130258:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff941010710400. 00000020:00000010:1.0:1767323547.909128:0:130258:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410089e7000. 00000020:00000010:1.0:1767323547.909133:0:130258:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941010710200. 80000000:00000010:1.0:1767323547.909139:0:130258:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941010de5900. 00040000:00000010:1.0:1767323547.909145:0:130258:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941010711e00. 20000000:00000010:1.0:1767323547.909149:0:130258:0:(mgs_handler.c:1706:mgs_key_init()) kmalloced '(value)': 392 at ffff941010711800. 00000040:00000010:1.0:1767323547.909158:0:130258:0:(llog.c:42:llog_alloc_handle()) kmalloced '(loghandle)': 352 at ffff941010711400. 00000100:00000010:1.0:1767323547.909166:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3f100. 02000000:00000010:1.0:1767323547.909204:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff941010710a00. 00000100:00000010:1.0:1767323547.909222:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941008e720c0. 02000000:00000010:1.0:1767323547.909246:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941006171000. 00000400:00000010:1.0:1767323547.909253:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156d68. 00000400:00000010:1.0:1767323547.909260:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a2a8. 00000100:00000200:1.0:1767323547.909268:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975833984, portal 25 00000400:00000010:1.0:1767323547.909273:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a220. 00000100:00000200:1.0:1767323547.909276:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 512 bytes to portal 26, xid 1853171975833984, offset 0 00000400:00000200:1.0:1767323547.909285:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323547.909301:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323547.909308:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323547.909313:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323547.909318:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323547.909321:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.909325:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1433:1433:256:4294967295] 192.168.204.130@tcp LPNI seq info [1433:1433:8:4294967295] 00000400:00000200:1.0:1767323547.909338:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323547.909344:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 512 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323547.909350:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c700. 00000800:00000200:1.0:1767323547.909358:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323547.909368:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323547.909374:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c700 type 1, nob 608 niov 1 nkiov 1 00000800:00000200:3.0:1767323547.909546:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323547.909551:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c700. 00000400:00000200:3.0:1767323547.909557:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323547.909564:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323547.909570:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a220 00000400:00000010:3.0:1767323547.909572:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a220. 00000100:00000200:3.0:1767323547.909579:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3f100 x1853171975833984/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 512/272 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1767323547.911556:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323547.911577:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 272 into portal 25 MB=0x695733953c980 00000400:00000200:1.0:1767323547.911588:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 272/272 into md 0x2ed1 [1] + 224 00000400:00000200:1.0:1767323547.911606:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323547.911611:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:1.0:1767323547.911624:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3f100 x1853171975833984/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 512/272 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:3.0:1767323547.911972:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156d68. 00000400:00000200:3.0:1767323547.911979:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a2a8 00000400:00000010:3.0:1767323547.911983:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a2a8. 00000100:00000200:3.0:1767323547.911992:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3f100 x1853171975833984/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 512/272 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323547.912002:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3f100 x1853171975833984/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 512/272 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:3.0:1767323547.912036:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941008e720c0. 02000000:00000010:3.0:1767323547.912058:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941006171000. 02000000:00000010:3.0:1767323547.912064:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff941010710a00. 00000100:00000010:3.0:1767323547.912071:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3f100. 00000040:00000010:3.0:1767323547.912079:0:130258:0:(llog.c:72:llog_free_handle()) kfreed 'loghandle': 352 at ffff941010711400. 00000020:00000010:3.0:1767323547.912091:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941010711c00. 00000040:00000010:3.0:1767323547.912107:0:130258:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff941010710400. 00000020:00000010:3.0:1767323547.912113:0:130258:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff9410089e7000. 00000020:00000010:3.0:1767323547.912120:0:130258:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff941010710200. 80000000:00000010:3.0:1767323547.912125:0:130258:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff941010de5900. 00040000:00000010:3.0:1767323547.912133:0:130258:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff941010711e00. 20000000:00000010:3.0:1767323547.912138:0:130258:0:(mgs_handler.c:1706:mgs_key_fini()) kfreed 'info': 392 at ffff941010711800. 00000020:00000010:3.0:1767323547.912142:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941010710600. 10000000:00000010:3.0:1767323547.912146:0:130258:0:(mgc_request.c:1741:mgc_process_cfg_log()) kfreed 'env': 56 at ffff9410081d1080. 10000000:00000010:3.0:1767323547.912183:0:130258:0:(mgc_request.c:197:do_config_log_add()) kmalloced '(cld)': 279 at ffff94100776c200. 10000000:00000010:3.0:1767323547.912191:0:130258:0:(mgc_request.c:197:do_config_log_add()) kmalloced '(cld)': 286 at ffff94100776d400. 10000000:00000010:3.0:1767323547.912196:0:130258:0:(mgc_request.c:197:do_config_log_add()) kmalloced '(cld)': 285 at ffff94100776c400. 00000100:00000010:3.0:1767323547.912204:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118eb100. 02000000:00000010:3.0:1767323547.912218:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff94100776d200. 00010000:00000010:3.0:1767323547.912238:0:130258:0:(ldlm_lock.c:433:ldlm_lock_new()) slab-alloced 'lock': 512 at ffff941039717a00. 00000020:00000010:3.0:1767323547.912246:0:130258:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 64 at ffff94100769a400. 00000100:00000010:3.0:1767323547.912267:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941039868b40. 02000000:00000010:3.0:1767323547.912292:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff94100a637400. 00000400:00000010:3.0:1767323547.912297:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328898. 00000400:00000010:3.0:1767323547.912303:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec550. 00000100:00000200:3.0:1767323547.912311:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975834112, portal 25 00000400:00000010:3.0:1767323547.912316:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec770. 00000100:00000200:3.0:1767323547.912320:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1853171975834112, offset 0 00000400:00000200:3.0:1767323547.912328:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323547.912342:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323547.912349:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323547.912354:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323547.912359:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323547.912362:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323547.912374:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1434:1434:256:4294967295] 192.168.204.130@tcp LPNI seq info [1434:1434:8:4294967295] 00000400:00000200:3.0:1767323547.912413:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323547.912422:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 328 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323547.912428:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941010a67a00. 00000800:00000200:3.0:1767323547.912436:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323547.912445:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323547.912450:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941010a67a00 type 1, nob 424 niov 1 nkiov 1 00000800:00000200:3.0:1767323547.913222:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323547.913228:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941010a67a00. 00000400:00000200:3.0:1767323547.913233:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323547.913239:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323547.913245:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec770 00000400:00000010:3.0:1767323547.913247:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec770. 00000100:00000200:3.0:1767323547.913254:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118eb100 x1853171975834112/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1767323547.914381:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323547.914426:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 344 into portal 25 MB=0x695733953ca00 00000400:00000200:3.0:1767323547.914494:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 344/344 into md 0x2ed9 [1] + 224 00000400:00000200:3.0:1767323547.914516:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323547.914520:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:3.0:1767323547.914532:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118eb100 x1853171975834112/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323547.914990:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328898. 00000400:00000200:1.0:1767323547.915004:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec550 00000400:00000010:1.0:1767323547.915007:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec550. 00000100:00000200:1.0:1767323547.915015:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118eb100 x1853171975834112/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323547.915026:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118eb100 x1853171975834112/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1767323547.915054:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941039868b40. 02000000:00000010:1.0:1767323547.915079:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff94100a637400. 02000000:00000010:1.0:1767323547.915086:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff94100776d200. 00000100:00000010:1.0:1767323547.915091:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118eb100. 10000000:00000010:1.0:1767323547.915103:0:130258:0:(mgc_request.c:1693:mgc_process_cfg_log()) kmalloced '(env)': 56 at ffff9410081d1f00. 00000020:00000010:1.0:1767323547.915108:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941006171000. 00000020:00000010:1.0:1767323547.915114:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff9410065e6a00. 00000040:00000010:1.0:1767323547.915119:0:130258:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff9410065e7200. 00000020:00000010:1.0:1767323547.915124:0:130258:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410089e5800. 00000020:00000010:1.0:1767323547.915129:0:130258:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff9410065e6200. 80000000:00000010:1.0:1767323547.915133:0:130258:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941010de5d20. 00040000:00000010:1.0:1767323547.915139:0:130258:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff9410065e6e00. 20000000:00000010:1.0:1767323547.915144:0:130258:0:(mgs_handler.c:1706:mgs_key_init()) kmalloced '(value)': 392 at ffff9410065e6c00. 00000040:00000010:1.0:1767323547.915152:0:130258:0:(llog.c:42:llog_alloc_handle()) kmalloced '(loghandle)': 352 at ffff9410065e7000. 00000100:00000010:1.0:1767323547.915158:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3f800. 02000000:00000010:1.0:1767323547.915171:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff9410065e7e00. 00000100:00000010:1.0:1767323547.915184:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941008e726c0. 02000000:00000010:1.0:1767323547.915202:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410065e6000. 00000400:00000010:1.0:1767323547.915207:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156ec8. 00000400:00000010:1.0:1767323547.915212:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323547.915218:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975834240, portal 25 00000400:00000010:1.0:1767323547.915223:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a000. 00000100:00000200:1.0:1767323547.915227:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 512 bytes to portal 26, xid 1853171975834240, offset 0 00000400:00000200:1.0:1767323547.915234:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323547.915245:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323547.915252:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323547.915262:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323547.915265:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323547.915268:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.915272:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1435:1435:256:4294967295] 192.168.204.130@tcp LPNI seq info [1435:1435:8:4294967295] 00000400:00000200:1.0:1767323547.915281:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323547.915287:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 512 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323547.915293:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c900. 00000800:00000200:1.0:1767323547.915299:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323547.915306:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323547.915311:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c900 type 1, nob 608 niov 1 nkiov 1 00000800:00000200:3.0:1767323547.915685:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323547.915690:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c900. 00000400:00000200:3.0:1767323547.915694:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323547.915698:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323547.915702:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a000 00000400:00000010:3.0:1767323547.915703:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a000. 00000100:00000200:3.0:1767323547.915710:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3f800 x1853171975834240/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 512/272 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1767323547.917126:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323547.917149:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 272 into portal 25 MB=0x695733953ca80 00000400:00000200:3.0:1767323547.917160:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 272/272 into md 0x2ee1 [1] + 224 00000400:00000200:3.0:1767323547.917177:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323547.917180:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:3.0:1767323547.917193:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3f800 x1853171975834240/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 512/272 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323547.918088:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156ec8. 00000400:00000200:1.0:1767323547.918096:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a7f8 00000400:00000010:1.0:1767323547.918099:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323547.918108:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3f800 x1853171975834240/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 512/272 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323547.918120:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3f800 x1853171975834240/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 512/272 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1767323547.918152:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941008e726c0. 02000000:00000010:1.0:1767323547.918166:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410065e6000. 02000000:00000010:1.0:1767323547.918173:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff9410065e7e00. 00000100:00000010:1.0:1767323547.918178:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3f800. 00000040:00000010:1.0:1767323547.918193:0:130258:0:(llog.c:412:llog_init_handle()) kmalloced '(llh)': 8192 at ffff941006a06000. 00000100:00000010:1.0:1767323547.918199:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3f800. 02000000:00000010:1.0:1767323547.918213:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff9410065e7e00. 00000100:00000010:1.0:1767323547.918224:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941008e726c0. 02000000:00000010:1.0:1767323547.918271:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff941010a5c000. 00000400:00000010:1.0:1767323547.918277:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156ec8. 00000400:00000010:1.0:1767323547.918284:0:130258:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at ffff941008e72540. 00000100:00000200:1.0:1767323547.918291:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1853171975834368, portal 25 00000400:00000010:1.0:1767323547.918297:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323547.918306:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1853171975834368, offset 0 00000400:00000200:1.0:1767323547.918314:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323547.918327:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323547.918334:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323547.918339:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323547.918343:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323547.918346:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.918350:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1436:1436:256:4294967295] 192.168.204.130@tcp LPNI seq info [1436:1436:8:4294967295] 00000400:00000200:1.0:1767323547.918360:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323547.918367:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323547.918373:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c900. 00000800:00000200:1.0:1767323547.918380:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323547.918420:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323547.918426:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c900 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:3.0:1767323547.918547:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323547.918553:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c900. 00000400:00000200:3.0:1767323547.918559:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323547.918563:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323547.918567:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a7f8 00000400:00000010:3.0:1767323547.918569:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a7f8. 00000100:00000200:3.0:1767323547.918576:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3f800 x1853171975834368/t0(0) o503->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8416 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1767323547.921008:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323547.921035:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 8416 into portal 25 MB=0x695733953cb00 00000400:00000200:1.0:1767323547.921047:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 8416/8416 into md 0x2ee9 [4] + 224 00000400:00000200:1.0:1767323547.921097:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323547.921103:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:1.0:1767323547.921121:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3f800 x1853171975834368/t0(0) o503->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8416 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:2.0:1767323547.921233:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156ec8. 00000400:00000200:2.0:1767323547.921240:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008e72540 00000400:00000010:2.0:1767323547.921243:0:130258:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 184 at ffff941008e72540. 00000100:00000200:2.0:1767323547.921250:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3f800 x1853171975834368/t0(0) o503->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8416 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323547.921260:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3f800 x1853171975834368/t0(0) o503->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8416 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:2.0:1767323547.921294:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941008e726c0. 02000000:00000010:2.0:1767323547.921309:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff941010a5c000. 02000000:00000010:2.0:1767323547.921323:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff9410065e7e00. 00000100:00000010:2.0:1767323547.921330:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3f800. 00000040:00000010:2.0:1767323547.921351:0:130258:0:(llog.c:945:llog_process_or_fork()) kmalloced '(lpi)': 96 at ffff941011abba20. 00000020:00000010:0.0:1767323547.921748:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94102030e200. 00000020:00000010:0.0:1767323547.921757:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94102030e000. 00000040:00000010:0.0:1767323547.921763:0:130271:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff94100631e600. 00000020:00000010:0.0:1767323547.921771:0:130271:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff941002dbc800. 00000020:00000010:0.0:1767323547.921778:0:130271:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff941010bd73b8. 00000020:00000010:0.0:1767323547.921783:0:130271:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff94100631f600. 80000000:00000010:0.0:1767323547.921788:0:130271:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941007ba2c60. 40000000:00000010:0.0:1767323547.921793:0:130271:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff9410395e1740. 00100000:00000010:0.0:1767323547.921800:0:130271:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff941002dbf000. 00040000:00000010:0.0:1767323547.921806:0:130271:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941010ce9a00. 00040000:00000010:0.0:1767323547.921811:0:130271:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff941002dbb800. 00040000:00000010:0.0:1767323547.921816:0:130271:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff94100631e000. 00000004:00000010:0.0:1767323547.921822:0:130271:0:(mdd_device.c:2406:mdd_key_init()) kmalloced '(value)': 1872 at ffff941002dbe000. 00000004:00000010:0.0:1767323547.921829:0:130271:0:(mdt_handler.c:8363:mdt_key_init()) kmalloced '(value)': 2568 at ffff941004737000. 00000004:00000010:0.0:1767323547.921842:0:130271:0:(lod_dev.c:2338:lod_key_init()) kmalloced '(value)': 1224 at ffff9410202a5800. 00002000:00000010:0.0:1767323547.921849:0:130271:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff94101090ec00. 00000004:00000010:0.0:1767323547.921854:0:130271:0:(osp_dev.c:1816:osp_key_init()) kmalloced '(value)': 616 at ffff94101090c800. 00000020:00000010:0.0:1767323547.921860:0:130271:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff9410395e1fc0. 00000040:00000010:0.0:1767323547.921870:0:130271:0:(llog.c:570:llog_process_thread()) kmalloced '(buf)': 8192 at ffff941039642000. 00000100:00000010:0.0:1767323547.921879:0:130271:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5c00. 02000000:00000010:0.0:1767323547.921893:0:130271:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff94100631fe00. 00000100:00000010:0.0:1767323547.921906:0:130271:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941039a15000. 02000000:00000010:0.0:1767323547.921952:0:130271:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff941010a5c000. 00000400:00000010:0.0:1767323547.921959:0:130271:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107168f0. 00000400:00000010:0.0:1767323547.921966:0:130271:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at ffff941039a15600. 00000100:00000200:0.0:1767323547.921975:0:130271:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1853171975834496, portal 25 00000400:00000010:0.0:1767323547.921983:0:130271:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997198. 00000100:00000200:0.0:1767323547.921986:0:130271:0:(niobuf.c:94:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1853171975834496, offset 0 00000400:00000200:0.0:1767323547.921995:0:130271:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323547.922008:0:130271:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323547.922014:0:130271:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323547.922019:0:130271:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323547.922024:0:130271:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323547.922026:0:130271:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323547.922030:0:130271:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1437:1437:256:4294967295] 192.168.204.130@tcp LPNI seq info [1437:1437:8:4294967295] 00000400:00000200:0.0:1767323547.922040:0:130271:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323547.922047:0:130271:0:(socklnd_cb.c:1001:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323547.922055:0:130271:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005312200. 00000800:00000200:0.0:1767323547.922061:0:130271:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323547.922071:0:130271:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323547.922076:0:130271:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005312200 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:1.0:1767323547.922256:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323547.922262:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005312200. 00000400:00000200:1.0:1767323547.922265:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323547.922270:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323547.922275:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997198 00000400:00000010:1.0:1767323547.922277:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997198. 00000100:00000200:1.0:1767323547.922285:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5c00 x1853171975834496/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323547.927366:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323547.927509:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 8472 into portal 25 MB=0x695733953cb80 00000400:00000200:0.0:1767323547.927523:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 8472/8472 into md 0x2ef1 [4] + 224 00000400:00000200:0.0:1767323547.927560:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.927566:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323547.927585:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5c00 x1853171975834496/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000010:2.0:1767323547.931074:0:130271:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107168f0. 00000400:00000200:2.0:1767323547.931096:0:130271:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039a15600 00000400:00000010:2.0:1767323547.931099:0:130271:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 184 at ffff941039a15600. 00000100:00000200:2.0:1767323547.931119:0:130271:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5c00 x1853171975834496/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323547.931132:0:130271:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5c00 x1853171975834496/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000010:2.0:1767323547.931169:0:130271:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941039a15000. 02000000:00000010:2.0:1767323547.931185:0:130271:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff941010a5c000. 02000000:00000010:2.0:1767323547.931201:0:130271:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff94100631fe00. 00000100:00000010:2.0:1767323547.931206:0:130271:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5c00. 00000020:00000010:2.0:1767323547.931231:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941018029600. 00000020:00000010:2.0:1767323547.931236:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941018029600. 00000020:00000010:2.0:1767323547.931243:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff941010bef340. 00000020:00000010:2.0:1767323547.931248:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.931262:0:130271:0:(genops.c:51:obd_device_alloc()) slab-alloced 'obd': 6360 at ffff94100772b1b0. 00000020:00000010:2.0:1767323547.931273:0:130271:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff941020248000. 00000020:00000010:2.0:1767323547.931293:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.931297:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff941010bef340. 00000020:00000010:2.0:1767323547.931301:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff941010bef340. 00000020:00000010:2.0:1767323547.931305:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 160 at ffff94101094ef00. 00000001:00000010:2.0:1767323547.931335:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941018029600. 00000001:00000010:2.0:1767323547.931341:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8f160. 00000001:00000010:2.0:1767323547.931346:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007300200. 00000001:00000010:2.0:1767323547.931349:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007300600. 00000001:00000010:2.0:1767323547.931352:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007301600. 00000001:00000010:2.0:1767323547.931355:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff9410066bb400. 00000001:00000010:2.0:1767323547.931359:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941018029400. 00000001:00000010:2.0:1767323547.931361:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8ffe0. 00000001:00000010:2.0:1767323547.931365:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff9410092bc800. 00000001:00000010:2.0:1767323547.931377:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941010950a00. 00000001:00000010:2.0:1767323547.931380:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941010951e00. 00000001:00000010:2.0:1767323547.931398:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941010951200. 00000020:00000010:2.0:1767323547.931406:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941010950800. 00000020:00000010:2.0:1767323547.931412:0:130271:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.931419:0:130271:0:(tgt_main.c:756:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff941010219640. 00008000:00000010:2.0:1767323547.931426:0:130271:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.931433:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941003d28400. 00000020:00000010:2.0:1767323547.931437:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941003d29800. 00000020:00000010:2.0:1767323547.931442:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941011abbc00. 00008000:00000010:2.0:1767323547.931447:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00020000:00000010:2.0:1767323547.931453:0:130271:0:(lov_dev.c:609:lov_device_alloc()) kmalloced '(ld)': 584 at ffff941008acc000. 00000020:00000010:2.0:1767323547.931475:0:130271:0:(lu_tgt_pool.c:52:lu_tgt_pool_init()) kmalloced '(op->op_array)': 8 at ffff941039d8d2c8. 00020000:00000010:2.0:1767323547.931655:0:130271:0:(lov_dev.c:626:lov_device_alloc()) kmalloced '(ld->ld_md_tgts)': 4096 at ffff941006332000. 00020000:00000010:2.0:1767323547.931661:0:130271:0:(lov_dev.c:633:lov_device_alloc()) kmalloced '(ld->ld_lov->lov_mdc_tgts)': 4096 at ffff941006333000. 00000020:00000010:2.0:1767323547.931696:0:130271:0:(lu_object.c:1121:lu_site_init()) kmalloced '(s->ls_bkts)': 14336 at ffff941010a5c000. 00000020:00000010:2.0:1767323547.931707:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff9410180c7800. 00000020:00000010:2.0:1767323547.931711:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 192 at ffff94101094ecc0. 00000020:00000010:2.0:1767323547.931723:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941003d29800. 00000020:00000010:2.0:1767323547.931727:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941011abbc00. 00008000:00000010:2.0:1767323547.931731:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.931735:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941003d28400. 00000020:00000010:2.0:1767323547.931739:0:130271:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.931743:0:130271:0:(tgt_main.c:768:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff941010219640. 00008000:00000010:2.0:1767323547.931746:0:130271:0:(echo_client.c:449:echo_session_key_fini()) slab-freed '(session)': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.931749:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941010950800. 00000020:00000010:2.0:1767323547.931754:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 160 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.931757:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff941010bef340. 00000020:00000010:2.0:1767323547.931763:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941018029800. 00000020:00000010:2.0:1767323547.931765:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941018029800. 00000020:00000010:2.0:1767323547.931769:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941018029800. 00000020:00000010:2.0:1767323547.931777:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941018029800. 00000020:00000010:2.0:1767323547.931782:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff941010bef340. 00000020:00000010:2.0:1767323547.931785:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.931791:0:130271:0:(genops.c:51:obd_device_alloc()) slab-alloced 'obd': 6360 at ffff9410077298d8. 00000020:00000010:2.0:1767323547.931796:0:130271:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff94102024a000. 00000020:00000010:2.0:1767323547.931804:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.931806:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff941010bef340. 00000020:00000010:2.0:1767323547.931809:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff941010bef340. 00000020:00000010:2.0:1767323547.931812:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 160 at ffff94101094ef00. 00000001:00000010:2.0:1767323547.931824:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941018029800. 00000001:00000010:2.0:1767323547.931827:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8f4a0. 00000001:00000010:2.0:1767323547.931830:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941003d28400. 00000001:00000010:2.0:1767323547.931832:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941003d29800. 00000001:00000010:2.0:1767323547.931837:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941003d29200. 00000001:00000010:2.0:1767323547.931840:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941003d28000. 00000001:00000010:2.0:1767323547.931844:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941018029a00. 00000001:00000010:2.0:1767323547.931846:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8fb20. 00000001:00000010:2.0:1767323547.931849:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941010950800. 00000001:00000010:2.0:1767323547.931854:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff9410099ae600. 00000001:00000010:2.0:1767323547.931858:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007379c00. 00000001:00000010:2.0:1767323547.931862:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007378c00. 00000020:00000010:2.0:1767323547.931865:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941007379600. 00000020:00000010:2.0:1767323547.931867:0:130271:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.931870:0:130271:0:(tgt_main.c:756:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff941010219640. 00020000:00000010:2.0:1767323547.931875:0:130271:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.931878:0:130271:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.931882:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941007378400. 00000020:00000010:2.0:1767323547.931885:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941007379200. 00000040:00000010:2.0:1767323547.931889:0:130271:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff941007378a00. 00000020:00000010:2.0:1767323547.931894:0:130271:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff94102024f800. 00000020:00000010:2.0:1767323547.931899:0:130271:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941007378000. 00040000:00000010:2.0:1767323547.931909:0:130271:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941018029900. 00040000:00000010:2.0:1767323547.931914:0:130271:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941007379000. 00800000:00000010:2.0:1767323547.931920:0:130271:0:(lmv_obd.c:1220:lmv_device_alloc()) kmalloced '(lu)': 64 at ffff941010befc00. 00000020:00000010:2.0:1767323547.932033:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941005f77000. 00000020:00000010:2.0:1767323547.932038:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 512 at ffff941007378600. 80000000:00000010:2.0:1767323547.932055:0:130271:0:(fld_cache.c:42:fld_cache_init()) kmalloced '(cache)': 168 at ffff94101094e000. 00800000:00000010:2.0:1767323547.932085:0:130271:0:(lmv_obd.c:1280:lmv_device_alloc()) kmalloced '(pat)': 280 at ffff941007379e00. 00800000:00000010:2.0:1767323547.932088:0:130271:0:(lmv_obd.c:1289:lmv_device_alloc()) kmalloced '(pat)': 280 at ffff941007378200. 00000020:00000010:2.0:1767323547.932092:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941007379200. 00000040:00000010:2.0:1767323547.932095:0:130271:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff941007378a00. 00000020:00000010:2.0:1767323547.932098:0:130271:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff94102024f800. 00000020:00000010:2.0:1767323547.932102:0:130271:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff941007378000. 00040000:00000010:2.0:1767323547.932106:0:130271:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 248 at ffff941018029900. 00040000:00000010:2.0:1767323547.932110:0:130271:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff941007379000. 00000020:00000010:2.0:1767323547.932112:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941007378400. 00000020:00000010:2.0:1767323547.932116:0:130271:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.932118:0:130271:0:(tgt_main.c:768:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff941010219640. 00020000:00000010:2.0:1767323547.932121:0:130271:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.932125:0:130271:0:(echo_client.c:449:echo_session_key_fini()) slab-freed '(session)': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.932128:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941007379600. 00000020:00000010:2.0:1767323547.932131:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 160 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.932134:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff941010bef340. 00000020:00000010:2.0:1767323547.932139:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941018029900. 00000020:00000010:2.0:1767323547.932142:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941018029900. 00000020:00000010:2.0:1767323547.932146:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941018029900. 00000020:00000010:2.0:1767323547.932148:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941018029900. 00000020:00000010:2.0:1767323547.932151:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 96 at ffff941011abbc00. 00000020:00000010:2.0:1767323547.932156:0:130271:0:(obd_config.c:1076:class_add_profile()) kmalloced '(lprof)': 48 at ffff941010bef340. 00000020:00000010:2.0:1767323547.932159:0:130271:0:(obd_config.c:1082:class_add_profile()) kmalloced '(lprof->lp_profile)': 14 at ffff941011c08250. 00000020:00000010:2.0:1767323547.932162:0:130271:0:(obd_config.c:1088:class_add_profile()) kmalloced '(lprof->lp_dt)': 14 at ffff941011c08a60. 00000020:00000010:2.0:1767323547.932165:0:130271:0:(obd_config.c:1095:class_add_profile()) kmalloced '(lprof->lp_md)': 14 at ffff941011c08c20. 00000020:00000010:2.0:1767323547.932168:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 96 at ffff941011abbc00. 00000020:00000010:2.0:1767323547.932178:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941018029900. 00000020:00000010:2.0:1767323547.932180:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941018029900. 00000020:00000010:2.0:1767323547.932187:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941018029900. 00000020:00000010:2.0:1767323547.932190:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941018029900. 00000020:00000010:2.0:1767323547.932194:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 64 at ffff941010bef680. 00000100:00000010:2.0:1767323547.932200:0:130271:0:(lustre_peer.c:71:class_add_uuid()) kmalloced '(data)': 704 at ffff941005f77c00. 00000400:00000200:2.0:1767323547.932205:0:130271:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:2.0:1767323547.932211:0:130271:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:2.0:1767323547.932219:0:130271:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:2.0:1767323547.932228:0:130271:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:2.0:1767323547.932232:0:130271:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:2.0:1767323547.932235:0:130271:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 00000100:00000010:2.0:1767323547.932239:0:130271:0:(lustre_peer.c:113:class_add_uuid()) kfreed 'data': 704 at ffff941005f77c00. 00000020:00000010:2.0:1767323547.932247:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 64 at ffff941010bef680. 00000020:00000010:2.0:1767323547.932252:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff941010bef680. 00000020:00000010:2.0:1767323547.932255:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.932262:0:130271:0:(genops.c:51:obd_device_alloc()) slab-alloced 'obd': 6360 at ffff94100772e360. 00000020:00000010:2.0:1767323547.932267:0:130271:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff94102024f800. 00000020:00000010:2.0:1767323547.932274:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.932277:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff941010bef680. 00000020:00000010:2.0:1767323547.932281:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff941010bef680. 00000020:00000010:2.0:1767323547.932285:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff94101094ef00. 00000001:00000010:2.0:1767323547.932302:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941018029900. 00000001:00000010:2.0:1767323547.932306:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8fa40. 00000001:00000010:2.0:1767323547.932309:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007379600. 00000001:00000010:2.0:1767323547.932312:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007378400. 00000001:00000010:2.0:1767323547.932314:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007379000. 00000001:00000010:2.0:1767323547.932317:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007378000. 00000001:00000010:2.0:1767323547.932321:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff94100a53f200. 00000001:00000010:2.0:1767323547.932326:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8f8a0. 00000001:00000010:2.0:1767323547.932328:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007378a00. 00000001:00000010:2.0:1767323547.932332:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007379200. 00000001:00000010:2.0:1767323547.932341:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007378e00. 00000001:00000010:2.0:1767323547.932345:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941007379a00. 00000020:00000010:2.0:1767323547.932350:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941018aab400. 00000020:00000010:2.0:1767323547.932353:0:130271:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.932356:0:130271:0:(tgt_main.c:756:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff941010219640. 00020000:00000010:2.0:1767323547.932359:0:130271:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.932363:0:130271:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.932368:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94100a604600. 00000020:00000010:2.0:1767323547.932371:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94100a604e00. 00000020:00000010:2.0:1767323547.932374:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941011abbc00. 00020000:00000010:2.0:1767323547.932379:0:130271:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.932406:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00000002:00000010:2.0:1767323547.932413:0:130271:0:(mdc_dev.c:1712:mdc_device_alloc()) kmalloced '(osc)': 104 at ffff941010b6b900. 00010000:00000010:2.0:1767323547.932428:0:130271:0:(ldlm_lib.c:421:client_obd_setup()) kmalloced '(cli->cl_read_io_latency_by_size)': 3920 at ffff941006331000. 00010000:00000010:2.0:1767323547.932434:0:130271:0:(ldlm_lib.c:434:client_obd_setup()) kmalloced '(cli->cl_write_io_latency_by_size)': 3920 at ffff941006334000. 00010000:00000010:2.0:1767323547.932441:0:130271:0:(ldlm_lib.c:522:client_obd_setup()) kmalloced '(cli->cl_mod_tag_bitmap)': 64 at ffff941010bef380. 00000020:00000010:2.0:1767323547.932448:0:130271:0:(genops.c:1281:class_new_import()) kmalloced '(imp)': 1712 at ffff941020249000. 00000100:00000200:2.0:1767323547.932465:0:130271:0:(events.c:560:ptlrpc_uuid_to_peer()) 192.168.204.130@tcp->12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323547.932472:0:130271:0:(peer.c:1531:LNetPrimaryNID()) NID 192.168.204.130@tcp primary NID 192.168.204.130@tcp rc 0 00010000:00000010:2.0:1767323547.932478:0:130271:0:(ldlm_lib.c:70:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff941011abb2a0. 00010000:00000010:2.0:1767323547.932485:0:130271:0:(ldlm_resource.c:780:ldlm_namespace_new()) kmalloced '(ns)': 816 at ffff94101805a000. 00000001:00000010:2.0:1767323547.932491:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 280 at ffff941009b36200. 00000001:00000010:2.0:1767323547.932495:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 256 at ffff94100a53fd00. 00000001:00000010:2.0:1767323547.932549:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a4b5000. 00000001:00000010:2.0:1767323547.932612:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a4bf000. 00000001:00000010:2.0:1767323547.932674:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a4c9000. 00000001:00000010:2.0:1767323547.932733:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a4d3000. 00000001:00000010:2.0:1767323547.932797:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a4dd000. 00000001:00000010:2.0:1767323547.932855:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a4e7000. 00000001:00000010:2.0:1767323547.932916:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a4f1000. 00000001:00000010:2.0:1767323547.932983:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a4fb000. 00000001:00000010:2.0:1767323547.933041:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a505000. 00000001:00000010:2.0:1767323547.933093:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a50f000. 00000001:00000010:2.0:1767323547.933147:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a519000. 00000001:00000010:2.0:1767323547.933196:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a523000. 00000001:00000010:2.0:1767323547.933248:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a52d000. 00000001:00000010:2.0:1767323547.933299:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a537000. 00000001:00000010:2.0:1767323547.933352:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a541000. 00000001:00000010:2.0:1767323547.933598:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a54b000. 00000001:00000010:2.0:1767323547.933650:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a555000. 00000001:00000010:2.0:1767323547.933702:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a55f000. 00000001:00000010:2.0:1767323547.933748:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a569000. 00000001:00000010:2.0:1767323547.933796:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a573000. 00000001:00000010:2.0:1767323547.933842:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a57d000. 00000001:00000010:2.0:1767323547.933896:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a587000. 00000001:00000010:2.0:1767323547.937831:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a591000. 00000001:00000010:2.0:1767323547.937939:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a59b000. 00000001:00000010:2.0:1767323547.938004:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5a5000. 00000001:00000010:2.0:1767323547.938072:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5af000. 00000001:00000010:2.0:1767323547.938137:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5b9000. 00000001:00000010:2.0:1767323547.938202:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5c3000. 00000001:00000010:2.0:1767323547.938265:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5cd000. 00000001:00000010:2.0:1767323547.938321:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5d7000. 00000001:00000010:2.0:1767323547.938374:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5e1000. 00000001:00000010:2.0:1767323547.939545:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5eb000. 00000020:00000010:2.0:1767323547.939643:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941018059c00. 00000020:00000010:2.0:1767323547.939647:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff941007b8f880. 00000020:00000010:2.0:1767323547.939725:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941018058000. 00000020:00000010:2.0:1767323547.939732:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff941005b1a000. 00000020:00000010:2.0:1767323547.939949:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941018059400. 00000020:00000010:2.0:1767323547.939954:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 512 at ffff941005b1b400. 00000020:00000010:2.0:1767323547.939986:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941018889c00. 00000020:00000010:2.0:1767323547.939998:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff941006330000. 00000040:00000010:2.0:1767323547.940025:0:130271:0:(llog_obd.c:26:llog_new_ctxt()) kmalloced '(ctxt)': 168 at ffff94101094ea80. 00000002:00000010:2.0:1767323547.940036:0:130271:0:(mdc_changelog.c:798:mdc_changelog_cdev_init()) kmalloced '(entry)': 1304 at ffff94102024d000. 00000020:00000010:2.0:1767323547.941011:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94100a604e00. 00000020:00000010:2.0:1767323547.941022:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941011abbc00. 00020000:00000010:2.0:1767323547.941029:0:130271:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.941036:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.941041:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94100a604600. 00000020:00000010:2.0:1767323547.941049:0:130271:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.941054:0:130271:0:(tgt_main.c:768:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff941010219640. 00020000:00000010:2.0:1767323547.941060:0:130271:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.941065:0:130271:0:(echo_client.c:449:echo_session_key_fini()) slab-freed '(session)': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.941070:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941018aab400. 00000020:00000010:2.0:1767323547.941078:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.941082:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff941010bef680. 00000020:00000010:2.0:1767323547.941097:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff941007605200. 00000020:00000010:2.0:1767323547.941103:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 152 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.941113:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941005b1b000. 00000020:00000010:2.0:1767323547.941118:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941005b1a800. 00000040:00000010:2.0:1767323547.941123:0:130271:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff941005b1ae00. 00000020:00000010:2.0:1767323547.941129:0:130271:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff94102024a800. 00000020:00000010:2.0:1767323547.941134:0:130271:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941005b1bc00. 00040000:00000010:2.0:1767323547.941141:0:130271:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941006340b00. 00040000:00000010:2.0:1767323547.941146:0:130271:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941005b1ac00. 00800000:00000010:2.0:1767323547.941164:0:130271:0:(lmv_obd.c:434:lmv_add_target()) kmalloced '(tgt)': 368 at ffff941005b1aa00. 00020000:00000010:2.0:1767323547.941171:0:130271:0:(lu_tgt_descs.c:376:ltd_add_tgt()) kmalloced '(ltd->ltd_tgt_idx[index / (((1UL) << 12) / sizeof(void *))])': 4096 at ffff941006337000. 00000020:00000010:2.0:1767323547.941174:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941005b1a800. 00000040:00000010:2.0:1767323547.941178:0:130271:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff941005b1ae00. 00000020:00000010:2.0:1767323547.941181:0:130271:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff94102024a800. 00000020:00000010:2.0:1767323547.941185:0:130271:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff941005b1bc00. 00040000:00000010:2.0:1767323547.941188:0:130271:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 248 at ffff941006340b00. 00040000:00000010:2.0:1767323547.941192:0:130271:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff941005b1ac00. 00000020:00000010:2.0:1767323547.941202:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941005b1b000. 00000020:00000010:2.0:1767323547.941207:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941005b1b000. 00000020:00000010:2.0:1767323547.941210:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941005b1ac00. 00000020:00000010:2.0:1767323547.941214:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941039a50000. 00020000:00000010:2.0:1767323547.941218:0:130271:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.941224:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.941236:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941005b1ac00. 00000020:00000010:2.0:1767323547.941239:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941039a50000. 00020000:00000010:2.0:1767323547.941242:0:130271:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.941244:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.941247:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941005b1b000. 00000020:00000010:2.0:1767323547.941250:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 152 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.941253:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff941007605200. 00000020:00000010:2.0:1767323547.941260:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941006340b00. 00000020:00000010:2.0:1767323547.941262:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941006340b00. 00000020:00000010:2.0:1767323547.941268:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941006340b00. 00000020:00000010:2.0:1767323547.941271:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941006340b00. 00000020:00000010:2.0:1767323547.941278:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941006340b00. 00000020:00000010:2.0:1767323547.941280:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941006340b00. 00000020:00000010:2.0:1767323547.941284:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 64 at ffff941007605200. 00000100:00000010:2.0:1767323547.941290:0:130271:0:(lustre_peer.c:71:class_add_uuid()) kmalloced '(data)': 704 at ffff94101076d400. 00000400:00000200:2.0:1767323547.941296:0:130271:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:2.0:1767323547.941304:0:130271:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:2.0:1767323547.941314:0:130271:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:2.0:1767323547.941325:0:130271:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:2.0:1767323547.941329:0:130271:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:2.0:1767323547.941332:0:130271:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 00000100:00000010:2.0:1767323547.941336:0:130271:0:(lustre_peer.c:113:class_add_uuid()) kfreed 'data': 704 at ffff94101076d400. 00000020:00000010:2.0:1767323547.941339:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 64 at ffff941007605200. 00000020:00000010:2.0:1767323547.941345:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.941348:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.941359:0:130271:0:(genops.c:51:obd_device_alloc()) slab-alloced 'obd': 6360 at ffff941007728000. 00000020:00000010:2.0:1767323547.941372:0:130271:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff94102024a800. 00000020:00000010:2.0:1767323547.945996:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.946015:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.946036:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.946043:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff94101094ef00. 00000001:00000010:2.0:1767323547.946070:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941006340b00. 00000001:00000010:2.0:1767323547.946076:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8f3c0. 00000001:00000010:2.0:1767323547.946081:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1b000. 00000001:00000010:2.0:1767323547.946083:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1ac00. 00000001:00000010:2.0:1767323547.946086:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1bc00. 00000001:00000010:2.0:1767323547.946089:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1ae00. 00000001:00000010:2.0:1767323547.946093:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff941006340400. 00000001:00000010:2.0:1767323547.946096:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8f6c0. 00000001:00000010:2.0:1767323547.946098:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1a800. 00000001:00000010:2.0:1767323547.946100:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1b600. 00000001:00000010:2.0:1767323547.946102:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1be00. 00000001:00000010:2.0:1767323547.946105:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1a600. 00000020:00000010:2.0:1767323547.946111:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941005b1ba00. 00000020:00000010:2.0:1767323547.946117:0:130271:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.946124:0:130271:0:(tgt_main.c:756:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff941010219640. 00020000:00000010:2.0:1767323547.946130:0:130271:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.946136:0:130271:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.946142:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941005b1b200. 00000020:00000010:2.0:1767323547.946148:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941005b1b800. 00000020:00000010:2.0:1767323547.946153:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941039a50000. 00020000:00000010:2.0:1767323547.946158:0:130271:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.946162:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00000002:00000010:2.0:1767323547.946168:0:130271:0:(mdc_dev.c:1712:mdc_device_alloc()) kmalloced '(osc)': 104 at ffff941010b6b680. 00010000:00000010:2.0:1767323547.946186:0:130271:0:(ldlm_lib.c:421:client_obd_setup()) kmalloced '(cli->cl_read_io_latency_by_size)': 3920 at ffff941006336000. 00010000:00000010:2.0:1767323547.946197:0:130271:0:(ldlm_lib.c:434:client_obd_setup()) kmalloced '(cli->cl_write_io_latency_by_size)': 3920 at ffff941003960000. 00010000:00000010:2.0:1767323547.946202:0:130271:0:(ldlm_lib.c:522:client_obd_setup()) kmalloced '(cli->cl_mod_tag_bitmap)': 64 at ffff941007605500. 00000020:00000010:2.0:1767323547.946208:0:130271:0:(genops.c:1281:class_new_import()) kmalloced '(imp)': 1712 at ffff94102024e000. 00000100:00000200:2.0:1767323547.946245:0:130271:0:(events.c:560:ptlrpc_uuid_to_peer()) 192.168.204.130@tcp->12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323547.946257:0:130271:0:(peer.c:1531:LNetPrimaryNID()) NID 192.168.204.130@tcp primary NID 192.168.204.130@tcp rc 0 00010000:00000010:2.0:1767323547.946264:0:130271:0:(ldlm_lib.c:70:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff941039a505a0. 00010000:00000010:2.0:1767323547.946270:0:130271:0:(ldlm_resource.c:780:ldlm_namespace_new()) kmalloced '(ns)': 816 at ffff94101076c800. 00000001:00000010:2.0:1767323547.946275:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 280 at ffff941018aab400. 00000001:00000010:2.0:1767323547.946279:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 256 at ffff941006340300. 00000001:00000010:2.0:1767323547.946351:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a5fd000. 00000001:00000010:2.0:1767323547.946430:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a607000. 00000001:00000010:2.0:1767323547.946486:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a611000. 00000001:00000010:2.0:1767323547.946542:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a61b000. 00000001:00000010:2.0:1767323547.946598:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a625000. 00000001:00000010:2.0:1767323547.946662:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a62f000. 00000001:00000010:2.0:1767323547.946719:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a639000. 00000001:00000010:2.0:1767323547.946775:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a643000. 00000001:00000010:2.0:1767323547.946835:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a64d000. 00000001:00000010:2.0:1767323547.946897:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a657000. 00000001:00000010:2.0:1767323547.946963:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a661000. 00000001:00000010:2.0:1767323547.947017:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a66b000. 00000001:00000010:2.0:1767323547.947073:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a675000. 00000001:00000010:2.0:1767323547.947150:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a67f000. 00000001:00000010:2.0:1767323547.947203:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a689000. 00000001:00000010:2.0:1767323547.947255:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a693000. 00000001:00000010:2.0:1767323547.947311:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a69d000. 00000001:00000010:2.0:1767323547.947368:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6a7000. 00000001:00000010:2.0:1767323547.947450:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6b1000. 00000001:00000010:2.0:1767323547.947510:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6bb000. 00000001:00000010:2.0:1767323547.947574:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6c5000. 00000001:00000010:2.0:1767323547.947638:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6cf000. 00000001:00000010:2.0:1767323547.947701:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6d9000. 00000001:00000010:2.0:1767323547.947768:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6e3000. 00000001:00000010:2.0:1767323547.947826:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6ed000. 00000001:00000010:2.0:1767323547.947887:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a6f7000. 00000001:00000010:2.0:1767323547.948074:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a701000. 00000001:00000010:2.0:1767323547.948129:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a70b000. 00000001:00000010:2.0:1767323547.948184:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a715000. 00000001:00000010:2.0:1767323547.948240:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a71f000. 00000001:00000010:2.0:1767323547.948294:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a729000. 00000001:00000010:2.0:1767323547.948349:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 32944 at ffffb7548a733000. 00000020:00000010:2.0:1767323547.948495:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94101076fc00. 00000020:00000010:2.0:1767323547.948501:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff941007b8f280. 00000020:00000010:2.0:1767323547.948569:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94101076c400. 00000020:00000010:2.0:1767323547.948573:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff94100a604600. 00000020:00000010:2.0:1767323547.948835:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94101076c000. 00000020:00000010:2.0:1767323547.948843:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 512 at ffff941020284e00. 00000020:00000010:2.0:1767323547.948871:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94101076d000. 00000020:00000010:2.0:1767323547.948874:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff941003963000. 00000040:00000010:2.0:1767323547.948898:0:130271:0:(llog_obd.c:26:llog_new_ctxt()) kmalloced '(ctxt)': 168 at ffff94101094e6c0. 00000002:00000010:2.0:1767323547.948910:0:130271:0:(mdc_changelog.c:798:mdc_changelog_cdev_init()) kmalloced '(entry)': 1304 at ffff94102024b000. 00000020:00000010:2.0:1767323547.955175:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941005b1b800. 00000020:00000010:2.0:1767323547.955189:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941039a50000. 00020000:00000010:2.0:1767323547.955196:0:130271:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.955203:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.955208:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941005b1b200. 00000020:00000010:2.0:1767323547.955213:0:130271:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.955218:0:130271:0:(tgt_main.c:768:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff941010219640. 00020000:00000010:2.0:1767323547.955223:0:130271:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.955228:0:130271:0:(echo_client.c:449:echo_session_key_fini()) slab-freed '(session)': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.955232:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941005b1ba00. 00000020:00000010:2.0:1767323547.955239:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.955243:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.955257:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff941007605200. 00000020:00000010:2.0:1767323547.955263:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 152 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.955286:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941005b1ba00. 00000020:00000010:2.0:1767323547.955290:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941005b1b200. 00000040:00000010:2.0:1767323547.955295:0:130271:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff941005b1b800. 00000020:00000010:2.0:1767323547.955301:0:130271:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff94102024b800. 00000020:00000010:2.0:1767323547.955306:0:130271:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941006318e00. 00040000:00000010:2.0:1767323547.955313:0:130271:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff94101a22a900. 00040000:00000010:2.0:1767323547.955318:0:130271:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941006319600. 00800000:00000010:2.0:1767323547.955335:0:130271:0:(lmv_obd.c:434:lmv_add_target()) kmalloced '(tgt)': 368 at ffff941006318c00. 00000020:00000010:2.0:1767323547.955340:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941005b1b200. 00000040:00000010:2.0:1767323547.955344:0:130271:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff941005b1b800. 00000020:00000010:2.0:1767323547.955346:0:130271:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff94102024b800. 00000020:00000010:2.0:1767323547.955351:0:130271:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff941006318e00. 00040000:00000010:2.0:1767323547.955355:0:130271:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 248 at ffff94101a22a900. 00040000:00000010:2.0:1767323547.955359:0:130271:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff941006319600. 00000020:00000010:2.0:1767323547.955362:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941005b1ba00. 00000020:00000010:2.0:1767323547.955367:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941006319600. 00000020:00000010:2.0:1767323547.955370:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941006318e00. 00000020:00000010:2.0:1767323547.955373:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941007a49060. 00020000:00000010:2.0:1767323547.955377:0:130271:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.955396:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.955406:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941006318e00. 00000020:00000010:2.0:1767323547.955409:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941007a49060. 00020000:00000010:2.0:1767323547.955413:0:130271:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.955416:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.955418:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941006319600. 00000020:00000010:2.0:1767323547.955421:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 152 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.955424:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff941007605200. 00000020:00000010:2.0:1767323547.955430:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff94101a22a900. 00000020:00000010:2.0:1767323547.955433:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff94101a22a900. 00000020:00000010:2.0:1767323547.955438:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff94101a22a900. 00000020:00000010:2.0:1767323547.955440:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff94101a22a900. 00000020:00000010:2.0:1767323547.955446:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff94101a22a900. 00000020:00000010:2.0:1767323547.955453:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff94101a22a900. 00000020:00000010:2.0:1767323547.955456:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 64 at ffff941007605200. 00000100:00000010:2.0:1767323547.955461:0:130271:0:(lustre_peer.c:71:class_add_uuid()) kmalloced '(data)': 704 at ffff941007725c00. 00000400:00000200:2.0:1767323547.955467:0:130271:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:2.0:1767323547.955476:0:130271:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:2.0:1767323547.955486:0:130271:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:2.0:1767323547.955498:0:130271:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:2.0:1767323547.955501:0:130271:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:2.0:1767323547.955504:0:130271:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 00000100:00000010:2.0:1767323547.955508:0:130271:0:(lustre_peer.c:113:class_add_uuid()) kfreed 'data': 704 at ffff941007725c00. 00000020:00000010:2.0:1767323547.955510:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 64 at ffff941007605200. 00000020:00000010:2.0:1767323547.955514:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.955517:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.955530:0:130271:0:(genops.c:51:obd_device_alloc()) slab-alloced 'obd': 6360 at ffff94100772ca88. 00000020:00000010:2.0:1767323547.955537:0:130271:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff94102024b800. 00000020:00000010:2.0:1767323547.955553:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.955556:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.955559:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.955562:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff94101094ef00. 00000001:00000010:2.0:1767323547.955580:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff94101a22a900. 00000001:00000010:2.0:1767323547.955585:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8fdc0. 00000001:00000010:2.0:1767323547.955589:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941006319600. 00000001:00000010:2.0:1767323547.955591:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941006318e00. 00000001:00000010:2.0:1767323547.955594:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941006318a00. 00000001:00000010:2.0:1767323547.955596:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941006318000. 00000001:00000010:2.0:1767323547.955599:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff94101a22ae00. 00000001:00000010:2.0:1767323547.955602:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff941007b8f5c0. 00000001:00000010:2.0:1767323547.955605:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1ba00. 00000001:00000010:2.0:1767323547.955607:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1b800. 00000001:00000010:2.0:1767323547.955610:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b1b200. 00000001:00000010:2.0:1767323547.955614:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff94100ac10400. 00000020:00000010:2.0:1767323547.955622:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94100137e000. 00000020:00000010:2.0:1767323547.955629:0:130271:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.955633:0:130271:0:(tgt_main.c:756:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff941010219640. 00020000:00000010:2.0:1767323547.955637:0:130271:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.955640:0:130271:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.955644:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94100137ec00. 00000020:00000010:2.0:1767323547.955646:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94100137e400. 00000020:00000010:2.0:1767323547.955648:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941007a49060. 00020000:00000010:2.0:1767323547.955650:0:130271:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.955653:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00000008:00000010:2.0:1767323547.955657:0:130271:0:(osc_dev.c:192:osc_device_alloc()) kmalloced '(osc)': 104 at ffff941010b6bd80. 00010000:00000010:2.0:1767323547.955671:0:130271:0:(ldlm_lib.c:421:client_obd_setup()) kmalloced '(cli->cl_read_io_latency_by_size)': 3920 at ffff941003961000. 00010000:00000010:2.0:1767323547.955676:0:130271:0:(ldlm_lib.c:434:client_obd_setup()) kmalloced '(cli->cl_write_io_latency_by_size)': 3920 at ffff941003962000. 00000020:00000010:2.0:1767323547.955685:0:130271:0:(genops.c:1281:class_new_import()) kmalloced '(imp)': 1712 at ffff941007818000. 00000100:00000200:2.0:1767323547.955703:0:130271:0:(events.c:560:ptlrpc_uuid_to_peer()) 192.168.204.130@tcp->12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323547.955710:0:130271:0:(peer.c:1531:LNetPrimaryNID()) NID 192.168.204.130@tcp primary NID 192.168.204.130@tcp rc 0 00010000:00000010:2.0:1767323547.955717:0:130271:0:(ldlm_lib.c:70:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff941007a49ea0. 00010000:00000010:2.0:1767323547.955723:0:130271:0:(ldlm_resource.c:780:ldlm_namespace_new()) kmalloced '(ns)': 816 at ffff941007724400. 00000001:00000010:2.0:1767323547.955728:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 280 at ffff9410088cb400. 00000001:00000010:2.0:1767323547.955731:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 128 at ffff941010b6b180. 00000001:00000010:2.0:1767323547.955737:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941007580000. 00000001:00000010:2.0:1767323547.955744:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941007586000. 00000001:00000010:2.0:1767323547.955751:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941007584000. 00000001:00000010:2.0:1767323547.955772:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941004130000. 00000001:00000010:2.0:1767323547.955781:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941004136000. 00000001:00000010:2.0:1767323547.955787:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941004134000. 00000001:00000010:2.0:1767323547.955794:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941004132000. 00000001:00000010:2.0:1767323547.955808:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410180fa000. 00000001:00000010:2.0:1767323547.955814:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410180f8000. 00000001:00000010:2.0:1767323547.955821:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410180fe000. 00000001:00000010:2.0:1767323547.955827:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410180fc000. 00000001:00000010:2.0:1767323547.955840:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff94100730a000. 00000001:00000010:2.0:1767323547.955851:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941007308000. 00000001:00000010:2.0:1767323547.955858:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff94100730e000. 00000001:00000010:2.0:1767323547.955865:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff94100730c000. 00000001:00000010:2.0:1767323547.955880:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff94100615e000. 00000020:00000010:2.0:1767323547.955956:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941007726c00. 00000020:00000010:2.0:1767323547.955961:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff94101002d2c0. 00000020:00000010:2.0:1767323547.956028:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941007724000. 00000020:00000010:2.0:1767323547.956032:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff9410088cb600. 00000020:00000010:2.0:1767323547.956237:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941007727000. 00000020:00000010:2.0:1767323547.956241:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff941003967000. 00000020:00000010:2.0:1767323547.956263:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94100137e400. 00000020:00000010:2.0:1767323547.956267:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941007a49060. 00020000:00000010:2.0:1767323547.956270:0:130271:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.956273:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.956275:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94100137ec00. 00000020:00000010:2.0:1767323547.956278:0:130271:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.956281:0:130271:0:(tgt_main.c:768:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff941010219640. 00020000:00000010:2.0:1767323547.956284:0:130271:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.956287:0:130271:0:(echo_client.c:449:echo_session_key_fini()) slab-freed '(session)': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.956290:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94100137e000. 00000020:00000010:2.0:1767323547.956293:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.956295:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.956301:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff941007605200. 00000020:00000010:2.0:1767323547.956305:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 120 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.956310:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff9410088ca800. 00000020:00000010:2.0:1767323547.956313:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff9410088cbe00. 00000020:00000010:2.0:1767323547.956316:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941007a49060. 00000008:00000010:2.0:1767323547.956322:0:130271:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff9410073a42f0. 00020000:00000010:2.0:1767323547.956325:0:130271:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.956328:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00020000:00000010:2.0:1767323547.956338:0:130271:0:(lov_obd.c:492:lov_add_target()) kmalloced '(tgt)': 368 at ffff94100137e000. 00020000:00000010:2.0:1767323547.956344:0:130271:0:(lu_tgt_descs.c:376:ltd_add_tgt()) kmalloced '(ltd->ltd_tgt_idx[index / (((1UL) << 12) / sizeof(void *))])': 4096 at ffff941003965000. 00020000:00000010:2.0:1767323547.956355:0:130271:0:(lov_dev.c:363:lov_expand_targets()) kmalloced '(newd)': 512 at ffff94100137ec00. 00000020:00000010:2.0:1767323547.956359:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff9410088cbe00. 00000020:00000010:2.0:1767323547.956362:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941007a49060. 00000008:00000010:2.0:1767323547.956366:0:130271:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff9410073a42f0. 00020000:00000010:2.0:1767323547.956369:0:130271:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.956372:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.956374:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff9410088ca800. 00000020:00000010:2.0:1767323547.956377:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 120 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.956380:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff941007605200. 00000020:00000010:2.0:1767323547.956412:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff94101a22ac00. 00000020:00000010:2.0:1767323547.956415:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff94101a22ac00. 00000020:00000010:2.0:1767323547.956420:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff94101a22ac00. 00000020:00000010:2.0:1767323547.956422:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff94101a22ac00. 00000020:00000010:2.0:1767323547.956427:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff94101a22ac00. 00000020:00000010:2.0:1767323547.956429:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff94101a22ac00. 00000020:00000010:2.0:1767323547.956432:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 64 at ffff941007605200. 00000100:00000010:2.0:1767323547.956436:0:130271:0:(lustre_peer.c:71:class_add_uuid()) kmalloced '(data)': 704 at ffff941007727800. 00000400:00000200:2.0:1767323547.956439:0:130271:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:2.0:1767323547.956443:0:130271:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:2.0:1767323547.956447:0:130271:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:2.0:1767323547.956453:0:130271:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:2.0:1767323547.956455:0:130271:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:2.0:1767323547.956458:0:130271:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 00000100:00000010:2.0:1767323547.956460:0:130271:0:(lustre_peer.c:113:class_add_uuid()) kfreed 'data': 704 at ffff941007727800. 00000020:00000010:2.0:1767323547.956464:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 64 at ffff941007605200. 00000020:00000010:2.0:1767323547.956467:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.956471:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.956488:0:130271:0:(genops.c:51:obd_device_alloc()) slab-alloced 'obd': 6360 at ffff941039c531b0. 00000020:00000010:2.0:1767323547.956494:0:130271:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff94100781a800. 00000020:00000010:2.0:1767323547.956503:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.956506:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.956510:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.956517:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 136 at ffff94101094ef00. 00000001:00000010:2.0:1767323547.956530:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff94101a22ac00. 00000001:00000010:2.0:1767323547.956534:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff94103b284200. 00000001:00000010:2.0:1767323547.956537:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff94100137e400. 00000001:00000010:2.0:1767323547.956539:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff9410088ca800. 00000001:00000010:2.0:1767323547.956542:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff9410088cbe00. 00000001:00000010:2.0:1767323547.956546:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941012f2f200. 00000001:00000010:2.0:1767323547.956549:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at ffff94101a10ff00. 00000001:00000010:2.0:1767323547.956553:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at ffff94103b284640. 00000001:00000010:2.0:1767323547.956556:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941003237a00. 00000001:00000010:2.0:1767323547.956561:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941012fbce00. 00000001:00000010:2.0:1767323547.956564:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941012fbcc00. 00000001:00000010:2.0:1767323547.956568:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at ffff941005b4fc00. 00000020:00000010:2.0:1767323547.956572:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941005b4e600. 00000020:00000010:2.0:1767323547.956574:0:130271:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.956578:0:130271:0:(tgt_main.c:756:tgt_ses_key_init()) slab-alloced 'session': 200 at ffff941010219640. 00000008:00000010:2.0:1767323547.956582:0:130271:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff941010aea840. 00020000:00000010:2.0:1767323547.956585:0:130271:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.956588:0:130271:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.956592:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941005b4f000. 00000020:00000010:2.0:1767323547.956596:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941005b4fa00. 00000020:00000010:2.0:1767323547.956599:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941007a49060. 00000008:00000010:2.0:1767323547.956601:0:130271:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff9410073a42f0. 00020000:00000010:2.0:1767323547.956604:0:130271:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.956607:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00000008:00000010:2.0:1767323547.956610:0:130271:0:(osc_dev.c:192:osc_device_alloc()) kmalloced '(osc)': 104 at ffff941010b6b400. 00010000:00000010:2.0:1767323547.956620:0:130271:0:(ldlm_lib.c:421:client_obd_setup()) kmalloced '(cli->cl_read_io_latency_by_size)': 3920 at ffff9410108b0000. 00010000:00000010:2.0:1767323547.956626:0:130271:0:(ldlm_lib.c:434:client_obd_setup()) kmalloced '(cli->cl_write_io_latency_by_size)': 3920 at ffff94101163a000. 00000020:00000010:2.0:1767323547.956633:0:130271:0:(genops.c:1281:class_new_import()) kmalloced '(imp)': 1712 at ffff94100781b000. 00000100:00000200:2.0:1767323547.956643:0:130271:0:(events.c:560:ptlrpc_uuid_to_peer()) 192.168.204.130@tcp->12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323547.956648:0:130271:0:(peer.c:1531:LNetPrimaryNID()) NID 192.168.204.130@tcp primary NID 192.168.204.130@tcp rc 0 00010000:00000010:2.0:1767323547.956652:0:130271:0:(ldlm_lib.c:70:import_set_conn()) kmalloced '(imp_conn)': 88 at ffff941007a49d80. 00010000:00000010:2.0:1767323547.956661:0:130271:0:(ldlm_resource.c:780:ldlm_namespace_new()) kmalloced '(ns)': 816 at ffff941007724c00. 00000001:00000010:2.0:1767323547.956664:0:130271:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 280 at ffff941005b4e000. 00000001:00000010:2.0:1767323547.956669:0:130271:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 128 at ffff941010b6b600. 00000001:00000010:2.0:1767323547.956675:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff94100615c000. 00000001:00000010:2.0:1767323547.956682:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff94100615a000. 00000001:00000010:2.0:1767323547.956690:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941006158000. 00000001:00000010:2.0:1767323547.956705:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941039eb8000. 00000001:00000010:2.0:1767323547.956713:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941039ebe000. 00000001:00000010:2.0:1767323547.956720:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941039ebc000. 00000001:00000010:2.0:1767323547.956727:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff941039eba000. 00000001:00000010:2.0:1767323547.956742:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410079ce000. 00000001:00000010:2.0:1767323547.956749:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410079cc000. 00000001:00000010:2.0:1767323547.956756:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410079ca000. 00000001:00000010:2.0:1767323547.956762:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410079c8000. 00000001:00000010:2.0:1767323547.956775:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410109e6000. 00000001:00000010:2.0:1767323547.956782:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410109e4000. 00000001:00000010:2.0:1767323547.956789:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410109e2000. 00000001:00000010:2.0:1767323547.956796:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff9410109e0000. 00000001:00000010:2.0:1767323547.956809:0:130271:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 4272 at ffff94100768a000. 00000020:00000010:2.0:1767323547.956854:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941007725000. 00000020:00000010:2.0:1767323547.956857:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 32 at ffff94103b284380. 00000020:00000010:2.0:1767323547.956905:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94100a77f000. 00000020:00000010:2.0:1767323547.956909:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 352 at ffff941005b4f600. 00000020:00000010:2.0:1767323547.957087:0:130271:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff94100a77d000. 00000020:00000010:2.0:1767323547.957091:0:130271:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 3680 at ffff941005ec2000. 00000020:00000010:2.0:1767323547.957111:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941005b4fa00. 00000020:00000010:2.0:1767323547.957114:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941007a49060. 00000008:00000010:2.0:1767323547.957117:0:130271:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff9410073a42f0. 00020000:00000010:2.0:1767323547.957119:0:130271:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.957123:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.957125:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941005b4f000. 00000020:00000010:2.0:1767323547.957136:0:130271:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.957138:0:130271:0:(tgt_main.c:768:tgt_ses_key_fini()) slab-freed '(session)': 200 at ffff941010219640. 00000008:00000010:2.0:1767323547.957141:0:130271:0:(osc_dev.c:125:osc_session_fini()) slab-freed '(info)': 352 at ffff941010aea840. 00020000:00000010:2.0:1767323547.957144:0:130271:0:(lov_dev.c:137:lov_session_key_fini()) slab-freed '(info)': 576 at ffff9410394de640. 00008000:00000010:2.0:1767323547.957146:0:130271:0:(echo_client.c:449:echo_session_key_fini()) slab-freed '(session)': 8 at ffff941011a81128. 00000020:00000010:2.0:1767323547.957148:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941005b4e600. 00000020:00000010:2.0:1767323547.957151:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 136 at ffff94101094ef00. 00000020:00000010:2.0:1767323547.957154:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 39 at ffff941007605200. 00000020:00000010:2.0:1767323547.957159:0:130271:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 34 at ffff941007605200. 00000020:00000010:2.0:1767323547.957162:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 120 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.957166:0:130271:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941005b4e600. 00000020:00000010:2.0:1767323547.957168:0:130271:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941005b4f000. 00000020:00000010:2.0:1767323547.957170:0:130271:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941007a49060. 00000008:00000010:2.0:1767323547.957173:0:130271:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff9410073a42f0. 00020000:00000010:2.0:1767323547.957175:0:130271:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.957178:0:130271:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941004378000. 00020000:00000010:2.0:1767323547.957184:0:130271:0:(lov_obd.c:492:lov_add_target()) kmalloced '(tgt)': 368 at ffff941005b4fa00. 00000020:00000010:2.0:1767323547.957189:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941005b4f000. 00000020:00000010:2.0:1767323547.957192:0:130271:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941007a49060. 00000008:00000010:2.0:1767323547.957194:0:130271:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff9410073a42f0. 00020000:00000010:2.0:1767323547.957197:0:130271:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410074926c0. 00008000:00000010:2.0:1767323547.957199:0:130271:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941004378000. 00000020:00000010:2.0:1767323547.957201:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941005b4e600. 00000020:00000010:2.0:1767323547.957203:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 120 at ffff941010b6ba80. 00000020:00000010:2.0:1767323547.957205:0:130271:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 34 at ffff941007605200. 00000020:00000010:2.0:1767323547.957212:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff9410083d7400. 00000020:00000010:2.0:1767323547.957214:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff9410083d7400. 00000020:00000010:2.0:1767323547.957219:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff9410083d7400. 00000020:00000010:2.0:1767323547.957221:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff9410083d7400. 00000020:00000010:2.0:1767323547.957223:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 56 at ffff941007605200. 00000020:00000010:2.0:1767323547.957225:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 56 at ffff941007605200. 00000020:00000010:2.0:1767323547.957229:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff9410083d7400. 00000020:00000010:2.0:1767323547.957236:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff9410083d7400. 00000100:00000010:2.0:1767323547.957251:0:130271:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f13800. 02000000:00000010:2.0:1767323547.957268:0:130271:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff941005b4e600. 00000100:00000010:2.0:1767323547.957285:0:130271:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff94101094ef00. 02000000:00000010:2.0:1767323547.957322:0:130271:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff9410077c0000. 00000400:00000010:2.0:1767323547.957330:0:130271:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35c08. 00000400:00000010:2.0:1767323547.957337:0:130271:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at ffff94101094e540. 00000100:00000200:2.0:1767323547.957346:0:130271:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1853171975834624, portal 25 00000400:00000010:2.0:1767323547.957352:0:130271:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3770. 00000100:00000200:2.0:1767323547.957355:0:130271:0:(niobuf.c:94:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1853171975834624, offset 0 00000400:00000200:2.0:1767323547.957364:0:130271:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323547.957377:0:130271:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323547.957406:0:130271:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323547.957412:0:130271:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323547.957416:0:130271:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323547.957418:0:130271:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323547.957423:0:130271:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1438:1438:256:4294967295] 192.168.204.130@tcp LPNI seq info [1438:1438:8:4294967295] 00000400:00000200:2.0:1767323547.957437:0:130271:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323547.957444:0:130271:0:(socklnd_cb.c:1001:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323547.957450:0:130271:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7400. 00000800:00000200:2.0:1767323547.957458:0:130271:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323547.957468:0:130271:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323547.957473:0:130271:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7400 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:1.0:1767323547.958515:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323547.958524:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7400. 00000400:00000200:1.0:1767323547.958530:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323547.958538:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323547.958545:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3770 00000400:00000010:1.0:1767323547.958548:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3770. 00000100:00000200:1.0:1767323547.958559:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f13800 x1853171975834624/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323547.971768:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323547.971793:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 8472 into portal 25 MB=0x695733953cc00 00000400:00000200:0.0:1767323547.971804:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 8472/8472 into md 0x2ef9 [4] + 224 00000400:00000200:0.0:1767323547.971832:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.971838:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323547.971857:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f13800 x1853171975834624/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000010:2.0:1767323547.975099:0:130271:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35c08. 00000400:00000200:2.0:1767323547.975117:0:130271:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101094e540 00000400:00000010:2.0:1767323547.975121:0:130271:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 184 at ffff94101094e540. 00000100:00000200:2.0:1767323547.975140:0:130271:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f13800 x1853171975834624/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323547.975154:0:130271:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f13800 x1853171975834624/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000010:2.0:1767323547.975221:0:130271:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff94101094ef00. 02000000:00000010:2.0:1767323547.975237:0:130271:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff9410077c0000. 02000000:00000010:2.0:1767323547.975254:0:130271:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff941005b4e600. 00000100:00000010:2.0:1767323547.975261:0:130271:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f13800. 00000020:00000010:2.0:1767323547.975285:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff9410083d7a00. 00000020:00000010:2.0:1767323547.975290:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff9410083d7a00. 00000020:00000010:2.0:1767323547.975298:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 96 at ffff941007a49060. 00000020:00000010:2.0:1767323547.975304:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 96 at ffff941007a49060. 00000100:00000010:2.0:1767323547.975318:0:130271:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f13800. 02000000:00000010:2.0:1767323547.975332:0:130271:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff941005b4e600. 00000100:00000010:2.0:1767323547.975346:0:130271:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff94101094ef00. 02000000:00000010:2.0:1767323547.975479:0:130271:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff9410077c0000. 00000400:00000010:2.0:1767323547.975488:0:130271:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35c08. 00000400:00000010:2.0:1767323547.975495:0:130271:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at ffff94101094e540. 00000100:00000200:2.0:1767323547.975504:0:130271:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1853171975834752, portal 25 00000400:00000010:2.0:1767323547.975511:0:130271:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3088. 00000100:00000200:2.0:1767323547.975515:0:130271:0:(niobuf.c:94:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1853171975834752, offset 0 00000400:00000200:2.0:1767323547.975523:0:130271:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323547.975541:0:130271:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323547.975550:0:130271:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323547.975556:0:130271:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323547.975562:0:130271:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323547.975565:0:130271:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323547.975569:0:130271:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1439:1439:256:4294967295] 192.168.204.130@tcp LPNI seq info [1439:1439:8:4294967295] 00000400:00000200:2.0:1767323547.975581:0:130271:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323547.975588:0:130271:0:(socklnd_cb.c:1001:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323547.975594:0:130271:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7a00. 00000800:00000200:2.0:1767323547.975602:0:130271:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323547.975611:0:130271:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323547.975623:0:130271:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7a00 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:0.0:1767323547.975832:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323547.975838:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7a00. 00000400:00000200:0.0:1767323547.975843:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.975849:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323547.975855:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3088 00000400:00000010:0.0:1767323547.975857:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3088. 00000100:00000200:0.0:1767323547.975864:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f13800 x1853171975834752/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1767323547.978985:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323547.979012:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 8472 into portal 25 MB=0x695733953cc80 00000400:00000200:1.0:1767323547.979023:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 8472/8472 into md 0x2f01 [4] + 224 00000400:00000200:1.0:1767323547.979060:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323547.979078:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:1.0:1767323547.979094:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f13800 x1853171975834752/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000010:2.0:1767323547.979445:0:130271:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35c08. 00000400:00000200:2.0:1767323547.979452:0:130271:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101094e540 00000400:00000010:2.0:1767323547.979455:0:130271:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 184 at ffff94101094e540. 00000100:00000200:2.0:1767323547.979463:0:130271:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f13800 x1853171975834752/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323547.979473:0:130271:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f13800 x1853171975834752/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000010:2.0:1767323547.979504:0:130271:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff94101094ef00. 02000000:00000010:2.0:1767323547.979520:0:130271:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff9410077c0000. 02000000:00000010:2.0:1767323547.979534:0:130271:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff941005b4e600. 00000100:00000010:2.0:1767323547.979540:0:130271:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f13800. 00000020:00000010:2.0:1767323547.979564:0:130271:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff9410083d7700. 00000020:00000010:2.0:1767323547.979570:0:130271:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff9410083d7700. 00000040:00000010:2.0:1767323547.979576:0:130271:0:(llog.c:891:llog_process_thread()) kvfree 'buf': 8192 at ffff941039642000. 00000020:00000010:2.0:1767323547.979587:0:130271:0:(lu_object.c:2001:lu_env_remove()) kfreed_rcu 'lei': 40 at ffff9410395e1fc0. 00000020:00000010:2.0:1767323547.979610:0:130271:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94102030e000. 00000040:00000010:2.0:1767323547.979614:0:130271:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff94100631e600. 00000020:00000010:2.0:1767323547.979619:0:130271:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff941002dbc800. 00000020:00000010:2.0:1767323547.979625:0:130271:0:(tgt_main.c:739:tgt_key_fini()) slab-freed '(info)': 1288 at ffff941010bd73b8. 00000020:00000010:2.0:1767323547.979632:0:130271:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff94100631f600. 80000000:00000010:2.0:1767323547.979636:0:130271:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff941007ba2c60. 40000000:00000010:2.0:1767323547.979642:0:130271:0:(fid_handler.c:473:seq_key_fini()) kfreed 'info': 48 at ffff9410395e1740. 00100000:00000010:2.0:1767323547.979648:0:130271:0:(lfsck_lib.c:43:lfsck_key_fini()) kfreed 'info': 1800 at ffff941002dbf000. 00040000:00000010:2.0:1767323547.979654:0:130271:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 248 at ffff941010ce9a00. 00040000:00000010:2.0:1767323547.979661:0:130271:0:(qmt_dev.c:343:qmt_key_fini()) kfreed 'info': 1256 at ffff941002dbb800. 00040000:00000010:2.0:1767323547.979668:0:130271:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff94100631e000. 00000004:00000010:2.0:1767323547.979673:0:130271:0:(mdd_device.c:2418:mdd_key_fini()) kfreed 'info': 1872 at ffff941002dbe000. 00000004:00000010:2.0:1767323547.979679:0:130271:0:(mdt_handler.c:8388:mdt_key_fini()) kfreed 'info': 2568 at ffff941004737000. 00000004:00000010:2.0:1767323547.979685:0:130271:0:(lod_dev.c:2364:lod_key_fini()) kfreed 'info': 1224 at ffff9410202a5800. 00002000:00000010:2.0:1767323547.979690:0:130271:0:(ofd_dev.c:3000:ofd_key_fini()) kfreed 'info': 816 at ffff94101090ec00. 00000004:00000010:2.0:1767323547.979694:0:130271:0:(osp_dev.c:1816:osp_key_fini()) kfreed 'info': 616 at ffff94101090c800. 00000020:00000010:2.0:1767323547.979708:0:130271:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94102030e200. 00000040:00000010:1.0:1767323547.980056:0:130258:0:(llog.c:986:llog_process_or_fork()) kfreed 'lpi': 96 at ffff941011abba20. 00000040:00000010:1.0:1767323547.980065:0:130258:0:(llog.c:70:llog_free_handle()) kvfree 'loghandle->lgh_hdr': 8192 at ffff941006a06000. 00000040:00000010:1.0:1767323547.980069:0:130258:0:(llog.c:72:llog_free_handle()) kfreed 'loghandle': 352 at ffff9410065e7000. 00000020:00000010:1.0:1767323547.980076:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff9410065e6a00. 00000040:00000010:1.0:1767323547.980080:0:130258:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff9410065e7200. 00000020:00000010:1.0:1767323547.980082:0:130258:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff9410089e5800. 00000020:00000010:1.0:1767323547.980086:0:130258:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff9410065e6200. 80000000:00000010:1.0:1767323547.980089:0:130258:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff941010de5d20. 00040000:00000010:1.0:1767323547.980092:0:130258:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff9410065e6e00. 20000000:00000010:1.0:1767323547.980097:0:130258:0:(mgs_handler.c:1706:mgs_key_fini()) kfreed 'info': 392 at ffff9410065e6c00. 00000020:00000010:1.0:1767323547.980100:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941006171000. 10000000:00000010:1.0:1767323547.980104:0:130258:0:(mgc_request.c:1741:mgc_process_cfg_log()) kfreed 'env': 56 at ffff9410081d1f00. 00000100:00000010:1.0:1767323547.980136:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d880. 02000000:00000010:1.0:1767323547.980152:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff94102030f400. 00010000:00000010:1.0:1767323547.980176:0:130258:0:(ldlm_resource.c:1286:ldlm_resource_new()) slab-alloced 'res': 248 at ffff9410032a7a00. 00010000:00000010:1.0:1767323547.980185:0:130258:0:(ldlm_lock.c:433:ldlm_lock_new()) slab-alloced 'lock': 512 at ffff941018107c00. 00000020:00000010:1.0:1767323547.980191:0:130258:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 64 at ffff9410081d1f00. 00000100:00000010:1.0:1767323547.980209:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941008e72300. 02000000:00000010:1.0:1767323547.980234:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff941018353c00. 00000400:00000010:1.0:1767323547.980240:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181567e8. 00000400:00000010:1.0:1767323547.980248:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323547.980255:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975834880, portal 25 00000400:00000010:1.0:1767323547.980260:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a000. 00000100:00000200:1.0:1767323547.980263:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1853171975834880, offset 0 00000400:00000200:1.0:1767323547.980270:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323547.980284:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323547.980291:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323547.980296:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323547.980301:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323547.980304:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.980308:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1440:1440:256:4294967295] 192.168.204.130@tcp LPNI seq info [1440:1440:8:4294967295] 00000400:00000200:1.0:1767323547.980318:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323547.980324:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 328 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323547.980329:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c700. 00000800:00000200:1.0:1767323547.980336:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323547.980345:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323547.980350:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c700 type 1, nob 424 niov 1 nkiov 1 00000800:00000200:0.0:1767323547.980503:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323547.980508:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c700. 00000400:00000200:0.0:1767323547.980512:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.980518:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323547.980523:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a000 00000400:00000010:0.0:1767323547.980525:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a000. 00000100:00000200:0.0:1767323547.980533:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d880 x1853171975834880/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323547.982777:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323547.982805:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 344 into portal 25 MB=0x695733953cd00 00000400:00000200:0.0:1767323547.982828:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 344/344 into md 0x2f09 [1] + 224 00000400:00000200:0.0:1767323547.982849:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.982854:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323547.982869:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d880 x1853171975834880/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323547.983489:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181567e8. 00000400:00000200:1.0:1767323547.983496:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a7f8 00000400:00000010:1.0:1767323547.983499:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323547.983509:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d880 x1853171975834880/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323547.983520:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d880 x1853171975834880/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1767323547.983566:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941008e72300. 02000000:00000010:1.0:1767323547.983597:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff941018353c00. 02000000:00000010:1.0:1767323547.983603:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff94102030f400. 00000100:00000010:1.0:1767323547.983609:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d880. 10000000:00000010:1.0:1767323547.983621:0:130258:0:(mgc_request.c:1544:mgc_process_recover_log()) kmalloced '(pages)': 2048 at ffff9410089e5800. 00000100:00000010:1.0:1767323547.985239:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d880. 02000000:00000010:1.0:1767323547.985265:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff94102030f400. 00000100:00000010:1.0:1767323547.985278:0:130258:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at ffff941018353c00. 00000100:00000010:1.0:1767323547.985289:0:130258:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 4096 at ffff941010d34000. 00000100:00000010:1.0:1767323547.985324:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941008e72300. 00000400:00000010:1.0:1767323547.985350:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181567e8. 00000400:00000010:1.0:1767323547.985366:0:130258:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 4216 at ffff941006a06000. 00000100:00000200:1.0:1767323547.985376:0:130258:0:(niobuf.c:453:ptlrpc_register_bulk()) Setup 1 bulk put-sink buffers: 256 pages 1048576 bytes, mbits x0x695733953cd80-0x695733953cd80, portal 33 02000000:00000010:1.0:1767323547.985401:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102030fe00. 00000400:00000010:1.0:1767323547.985404:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181562c0. 00000400:00000010:1.0:1767323547.985408:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323547.985412:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975835008, portal 25 00000400:00000010:1.0:1767323547.985418:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a2a8. 00000100:00000200:1.0:1767323547.985422:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 304 bytes to portal 26, xid 1853171975835008, offset 0 00000400:00000200:1.0:1767323547.985433:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323547.985452:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323547.985459:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323547.985464:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323547.985469:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323547.985472:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.985476:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1441:1441:256:4294967295] 192.168.204.130@tcp LPNI seq info [1441:1441:8:4294967295] 00000400:00000200:1.0:1767323547.985488:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323547.985494:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 304 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323547.985500:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c100. 00000800:00000200:1.0:1767323547.985513:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323547.985522:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323547.985527:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c100 type 1, nob 400 niov 1 nkiov 1 00000800:00000200:2.0:1767323547.986080:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323547.986087:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c100. 00000400:00000200:2.0:1767323547.986094:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323547.986102:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323547.986109:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a2a8 00000400:00000010:2.0:1767323547.986112:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a2a8. 00000100:00000200:2.0:1767323547.986123:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d880 x1853171975835008/t0(0) o256->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 304/240 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323547.988482:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323547.988508:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 176 into portal 33 MB=0x695733953cd80 00000400:00000200:0.0:1767323547.988520:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 21 from 12345-192.168.204.130@tcp of length 176/176 into md 0x2f11 [256] + 0 00000400:00000010:0.0:1767323547.988527:0:110994:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181567e8. 00000400:00000200:0.0:1767323547.988531:0:110994:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md ffff941006a06000 00000400:00000200:0.0:1767323547.988548:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.988553:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323547.988559:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941006a06000 00000400:00000010:0.0:1767323547.988561:0:110994:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 4216 at ffff941006a06000. 00000100:00000200:0.0:1767323547.988569:0:110994:0:(events.c:192:client_bulk_callback()) event type 2, status 0, req ffff941010e3d880 desc ffff941018353c00 mbits 1853171975835008 00000400:00000200:0.0:1767323547.988593:0:110994:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md 0000000000000000 with offset 0 00000400:00000200:0.0:1767323547.988601:0:110994:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source Specified: 192.168.204.30@tcp to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323547.988607:0:110994:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1442:1442:256:4294967295] 192.168.204.130@tcp LPNI seq info [1442:1442:8:4294967295] 00000400:00000200:0.0:1767323547.988618:0:110994:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:192.168.204.30@tcp) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) 192.168.204.130@tcp : ACK try# 0 00000800:00000200:0.0:1767323547.988624:0:110994:0:(socklnd_cb.c:1001:ksocknal_send()) sending 0 bytes in 256 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323547.988635:0:110994:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 4328 at ffff941039642000. 00000800:00000200:0.0:1767323547.988641:0:110994:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323547.988649:0:110994:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323547.988654:0:110994:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941039642000 type 0, nob 96 niov 1 nkiov 0 00000800:00000200:0.0:1767323547.988757:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323547.988761:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 4328 at ffff941039642000. 00000400:00000200:0.0:1767323547.988765:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.988769:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: ACK: OK 00000400:00000200:2.0:1767323547.990985:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323547.991007:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 240 into portal 25 MB=0x695733953cd80 00000400:00000200:2.0:1767323547.991019:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 240/240 into md 0x2f15 [1] + 224 00000400:00000200:2.0:1767323547.991038:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323547.991043:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:2.0:1767323547.991060:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d880 x1853171975835008/t0(0) o256->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 304/240 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323547.991152:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181562c0. 00000400:00000200:1.0:1767323547.991159:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a7f8 00000400:00000010:1.0:1767323547.991162:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323547.991169:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d880 x1853171975835008/t0(0) o256->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 304/240 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323547.991179:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d880 x1853171975835008/t0(0) o256->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 304/240 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1767323547.991212:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941008e72300. 10000000:00000010:1.0:1767323547.991230:0:130258:0:(mgc_request.c:1296:mgc_apply_recover_logs()) kmalloced '(buf)': 4096 at ffff941010d35000. 00000100:00000200:1.0:1767323547.991246:0:130258:0:(lustre_peer.c:175:class_add_nids_to_uuid()) Comparing 192.168.204.130@tcp with 192.168.204.130@tcp 00000100:00000200:1.0:1767323547.991249:0:130258:0:(lustre_peer.c:182:class_add_nids_to_uuid()) Updating UUID '192.168.204.130@tcp' 00000400:00000200:1.0:1767323547.991253:0:130258:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:1.0:1767323547.991257:0:130258:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.991262:0:130258:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:1.0:1767323547.991270:0:130258:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:1.0:1767323547.991273:0:130258:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:1.0:1767323547.991276:0:130258:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 10000000:00000010:1.0:1767323547.991285:0:130258:0:(mgc_request.c:1478:mgc_apply_recover_logs()) kmalloced '(lcfg)': 128 at ffff941011986400. 00000020:00000010:1.0:1767323547.991297:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94102030e200. 00000020:00000010:1.0:1767323547.991303:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94102030e000. 00000020:00000010:1.0:1767323547.991308:0:130258:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941010de5d20. 00000008:00000010:1.0:1767323547.991317:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323547.991323:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410119bbd80. 00008000:00000010:1.0:1767323547.991329:0:130258:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941006a0ce20. 00000020:00000010:1.0:1767323547.991550:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94102030e000. 00000020:00000010:1.0:1767323547.991556:0:130258:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941010de5d20. 00000008:00000010:1.0:1767323547.991560:0:130258:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323547.991564:0:130258:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410119bbd80. 00008000:00000010:1.0:1767323547.991568:0:130258:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941006a0ce20. 00000020:00000010:1.0:1767323547.991590:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94102030e200. 10000000:00000010:1.0:1767323547.991594:0:130258:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'lcfg': 128 at ffff941011986400. 00000100:00000200:1.0:1767323547.991602:0:130258:0:(lustre_peer.c:175:class_add_nids_to_uuid()) Comparing 192.168.204.130@tcp with 192.168.204.130@tcp 00000100:00000200:1.0:1767323547.991605:0:130258:0:(lustre_peer.c:182:class_add_nids_to_uuid()) Updating UUID '192.168.204.130@tcp' 00000400:00000200:1.0:1767323547.991607:0:130258:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:1.0:1767323547.991610:0:130258:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.991613:0:130258:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:1.0:1767323547.991617:0:130258:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:1.0:1767323547.991620:0:130258:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:1.0:1767323547.991622:0:130258:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 10000000:00000010:1.0:1767323547.991625:0:130258:0:(mgc_request.c:1478:mgc_apply_recover_logs()) kmalloced '(lcfg)': 128 at ffff941011986400. 00000020:00000010:1.0:1767323547.991630:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94102030e200. 00000020:00000010:1.0:1767323547.991632:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94102030e000. 00000020:00000010:1.0:1767323547.991635:0:130258:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941010de5d20. 00000008:00000010:1.0:1767323547.991638:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323547.991641:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410119bbd80. 00008000:00000010:1.0:1767323547.991643:0:130258:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941006a0ce20. 00000020:00000010:1.0:1767323547.995601:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94102030e000. 00000020:00000010:1.0:1767323547.995618:0:130258:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941010de5d20. 00000008:00000010:1.0:1767323547.995625:0:130258:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323547.995633:0:130258:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410119bbd80. 00008000:00000010:1.0:1767323547.995638:0:130258:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941006a0ce20. 00000020:00000010:1.0:1767323547.995647:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94102030e200. 10000000:00000010:1.0:1767323547.995652:0:130258:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'lcfg': 128 at ffff941011986400. 00000100:00000200:1.0:1767323547.995673:0:130258:0:(lustre_peer.c:175:class_add_nids_to_uuid()) Comparing 192.168.204.130@tcp with 192.168.204.130@tcp 00000100:00000200:1.0:1767323547.995676:0:130258:0:(lustre_peer.c:182:class_add_nids_to_uuid()) Updating UUID '192.168.204.130@tcp' 00000400:00000200:1.0:1767323547.995679:0:130258:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:1.0:1767323547.995687:0:130258:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.995697:0:130258:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:1.0:1767323547.995708:0:130258:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:1.0:1767323547.995711:0:130258:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:1.0:1767323547.995714:0:130258:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 10000000:00000010:1.0:1767323547.995724:0:130258:0:(mgc_request.c:1478:mgc_apply_recover_logs()) kmalloced '(lcfg)': 128 at ffff941011986400. 00000020:00000010:1.0:1767323547.995750:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94102030e200. 00000020:00000010:1.0:1767323547.995755:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94102030e000. 00000020:00000010:1.0:1767323547.995759:0:130258:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941010de5d20. 00000008:00000010:1.0:1767323547.995766:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323547.995770:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410119bbd80. 00008000:00000010:1.0:1767323547.995774:0:130258:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941006a0ce20. 00000020:00000010:1.0:1767323547.995832:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94102030e000. 00000020:00000010:1.0:1767323547.995835:0:130258:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941010de5d20. 00000008:00000010:1.0:1767323547.995838:0:130258:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323547.995840:0:130258:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410119bbd80. 00008000:00000010:1.0:1767323547.995842:0:130258:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941006a0ce20. 00000020:00000010:1.0:1767323547.995846:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94102030e200. 10000000:00000010:1.0:1767323547.995848:0:130258:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'lcfg': 128 at ffff941011986400. 00000100:00000200:1.0:1767323547.995855:0:130258:0:(lustre_peer.c:175:class_add_nids_to_uuid()) Comparing 192.168.204.130@tcp with 192.168.204.130@tcp 00000100:00000200:1.0:1767323547.995857:0:130258:0:(lustre_peer.c:182:class_add_nids_to_uuid()) Updating UUID '192.168.204.130@tcp' 00000400:00000200:1.0:1767323547.995859:0:130258:0:(peer.c:1355:LNetAddPeer()) Add peer with 1 NIDs 00000400:00000200:1.0:1767323547.995863:0:130258:0:(peer.c:1369:LNetAddPeer()) Adding NID[0]: 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.995867:0:130258:0:(peer.c:1797:lnet_peer_add()) peer 192.168.204.130@tcp NID flags 0x100001: -17 00000400:00000200:1.0:1767323547.995871:0:130258:0:(peer.c:2827:lnet_discover_peer_locked()) non-blocking discovery 00000400:00000200:1.0:1767323547.995875:0:130258:0:(peer.c:2836:lnet_discover_peer_locked()) peer 192.168.204.130@tcp NID 192.168.204.130@tcp: 0. pending discovery 00000400:00000200:1.0:1767323547.995878:0:130258:0:(peer.c:1420:LNetAddPeer()) A peer exists for NID 192.168.204.130@tcp 10000000:00000010:1.0:1767323547.995882:0:130258:0:(mgc_request.c:1478:mgc_apply_recover_logs()) kmalloced '(lcfg)': 128 at ffff941011986400. 00000020:00000010:1.0:1767323547.995887:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94102030e200. 00000020:00000010:1.0:1767323547.995890:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94102030e000. 00000020:00000010:1.0:1767323547.995893:0:130258:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941010de5d20. 00000008:00000010:1.0:1767323547.995897:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323547.995901:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410119bbd80. 00008000:00000010:1.0:1767323547.995904:0:130258:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941006a0ce20. 00000020:00000010:1.0:1767323547.995936:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94102030e000. 00000020:00000010:1.0:1767323547.995940:0:130258:0:(cl_object.c:1136:cl_key_fini()) kfreed 'info': 72 at ffff941010de5d20. 00000008:00000010:1.0:1767323547.995943:0:130258:0:(osc_dev.c:100:osc_key_fini()) slab-freed '(info)': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323547.995945:0:130258:0:(lov_dev.c:98:lov_key_fini()) slab-freed '(info)': 192 at ffff9410119bbd80. 00008000:00000010:1.0:1767323547.995948:0:130258:0:(echo_client.c:424:echo_thread_key_fini()) slab-freed '(info)': 904 at ffff941006a0ce20. 00000020:00000010:1.0:1767323547.995957:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94102030e200. 10000000:00000010:1.0:1767323547.995960:0:130258:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'lcfg': 128 at ffff941011986400. 10000000:00000010:1.0:1767323547.995963:0:130258:0:(mgc_request.c:1506:mgc_apply_recover_logs()) kfreed 'buf': 4096 at ffff941010d35000. 02000000:00000010:1.0:1767323547.995976:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102030fe00. 00000100:00000010:1.0:1767323547.996019:0:130258:0:(client.c:333:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 4096 at ffff941010d34000. 00000100:00000010:1.0:1767323547.996025:0:130258:0:(client.c:334:ptlrpc_free_bulk()) kfreed 'desc': 984 at ffff941018353c00. 02000000:00000010:1.0:1767323547.996031:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff94102030f400. 00000100:00000010:1.0:1767323547.996037:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d880. 10000000:00000010:1.0:1767323547.996654:0:130258:0:(mgc_request.c:1662:mgc_process_recover_log()) kvfree 'pages': 2048 at ffff9410089e5800. 00000100:00000010:1.0:1767323547.996734:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d880. 02000000:00000010:1.0:1767323547.996751:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff94102030f400. 00010000:00000010:1.0:1767323547.996771:0:130258:0:(ldlm_resource.c:1286:ldlm_resource_new()) slab-alloced 'res': 248 at ffff9410032a7600. 00010000:00000010:1.0:1767323547.996780:0:130258:0:(ldlm_lock.c:433:ldlm_lock_new()) slab-alloced 'lock': 512 at ffff941018106000. 00000100:00000010:1.0:1767323547.996801:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941008e72300. 02000000:00000010:1.0:1767323547.996829:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff941018353c00. 00000400:00000010:1.0:1767323547.996838:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181562c0. 00000400:00000010:1.0:1767323547.996847:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323547.996857:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975835136, portal 25 00000400:00000010:1.0:1767323547.996864:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a220. 00000100:00000200:1.0:1767323547.996867:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1853171975835136, offset 0 00000400:00000200:1.0:1767323547.996878:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323547.996893:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323547.996900:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323547.996905:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323547.996910:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323547.996914:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323547.996918:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1443:1443:256:4294967295] 192.168.204.130@tcp LPNI seq info [1443:1443:8:4294967295] 00000400:00000200:1.0:1767323547.996941:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323547.996949:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 328 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323547.996957:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4cb00. 00000800:00000200:1.0:1767323547.996965:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323547.996981:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323547.996986:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4cb00 type 1, nob 424 niov 1 nkiov 1 00000800:00000200:0.0:1767323547.997239:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323547.997245:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4cb00. 00000400:00000200:0.0:1767323547.997250:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323547.997256:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323547.997263:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a220 00000400:00000010:0.0:1767323547.997266:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a220. 00000100:00000200:0.0:1767323547.997277:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d880 x1853171975835136/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1767323548.007236:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323548.007263:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 344 into portal 25 MB=0x695733953ce00 00000400:00000200:2.0:1767323548.007275:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 344/344 into md 0x2f1d [1] + 224 00000400:00000200:2.0:1767323548.007298:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323548.007304:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:2.0:1767323548.007321:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d880 x1853171975835136/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323548.012932:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181562c0. 00000400:00000200:1.0:1767323548.012949:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a7f8 00000400:00000010:1.0:1767323548.012952:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323548.012974:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d880 x1853171975835136/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323548.012989:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d880 x1853171975835136/t0(0) o101->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 328/344 e 0 to 0 dl 1767323563 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1767323548.013027:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941008e72300. 02000000:00000010:1.0:1767323548.013062:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff941018353c00. 02000000:00000010:1.0:1767323548.013069:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff94102030f400. 00000100:00000010:1.0:1767323548.013075:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d880. 10000000:00000010:1.0:1767323548.013088:0:130258:0:(mgc_request.c:1693:mgc_process_cfg_log()) kmalloced '(env)': 56 at ffff9410081d1900. 00000020:00000010:1.0:1767323548.013093:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94102030f400. 00000020:00000010:1.0:1767323548.013100:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94102030ec00. 00000040:00000010:1.0:1767323548.013110:0:130258:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff94102030f800. 00000020:00000010:1.0:1767323548.013118:0:130258:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410089e5800. 00000020:00000010:1.0:1767323548.013124:0:130258:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941006171000. 80000000:00000010:1.0:1767323548.013130:0:130258:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941010de5d20. 00040000:00000010:1.0:1767323548.013137:0:130258:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff9410065e6000. 20000000:00000010:1.0:1767323548.013143:0:130258:0:(mgs_handler.c:1706:mgs_key_init()) kmalloced '(value)': 392 at ffff9410065e6c00. 00000040:00000010:1.0:1767323548.013153:0:130258:0:(llog.c:42:llog_alloc_handle()) kmalloced '(loghandle)': 352 at ffff9410065e6e00. 00000100:00000010:1.0:1767323548.013161:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d880. 02000000:00000010:1.0:1767323548.013177:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff9410065e6200. 00000100:00000010:1.0:1767323548.013193:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941008e72300. 02000000:00000010:1.0:1767323548.013222:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410065e7200. 00000400:00000010:1.0:1767323548.013230:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181562c0. 00000400:00000010:1.0:1767323548.013236:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323548.013245:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975835264, portal 25 00000400:00000010:1.0:1767323548.013252:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a880. 00000100:00000200:1.0:1767323548.013263:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 504 bytes to portal 26, xid 1853171975835264, offset 0 00000400:00000200:1.0:1767323548.013272:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323548.013293:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323548.013300:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323548.013306:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323548.013311:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323548.013314:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323548.013319:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1444:1444:256:4294967295] 192.168.204.130@tcp LPNI seq info [1444:1444:8:4294967295] 00000400:00000200:1.0:1767323548.013333:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323548.013341:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 504 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323548.013347:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4ca00. 00000800:00000200:1.0:1767323548.013355:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323548.013367:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323548.013372:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4ca00 type 1, nob 600 niov 1 nkiov 1 00000800:00000200:2.0:1767323548.017355:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323548.017369:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4ca00. 00000400:00000200:2.0:1767323548.017378:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323548.017410:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323548.017421:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a880 00000400:00000010:2.0:1767323548.017424:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a880. 00000100:00000200:2.0:1767323548.017447:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d880 x1853171975835264/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 504/272 e 0 to 0 dl 1767323564 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000010:3.0:1767323548.017721:0:130277:0:(lproc_ptlrpc.c:1375:ldebugfs_import_seq_write()) kmalloced '(kbuf)': 34 at ffff94100769a840. 00000020:00000010:3.0:1767323548.017731:0:130277:0:(lproc_ptlrpc.c:1427:ldebugfs_import_seq_write()) kfreed 'kbuf': 34 at ffff94100769a840. 00000400:00000200:0.0:1767323548.027060:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323548.027087:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 272 into portal 25 MB=0x695733953ce80 00000400:00000200:0.0:1767323548.027099:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 272/272 into md 0x2f25 [1] + 224 00000400:00000200:0.0:1767323548.027124:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.027129:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323548.027148:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d880 x1853171975835264/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 504/272 e 0 to 0 dl 1767323564 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323548.028690:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181562c0. 00000400:00000200:1.0:1767323548.028701:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a7f8 00000400:00000010:1.0:1767323548.028704:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323548.028716:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d880 x1853171975835264/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 504/272 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323548.028729:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d880 x1853171975835264/t0(0) o501->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 504/272 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1767323548.028767:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941008e72300. 02000000:00000010:1.0:1767323548.028781:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410065e7200. 02000000:00000010:1.0:1767323548.028788:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff9410065e6200. 00000100:00000010:1.0:1767323548.028794:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d880. 00000040:00000010:1.0:1767323548.028810:0:130258:0:(llog.c:412:llog_init_handle()) kmalloced '(llh)': 8192 at ffff941006a06000. 00000100:00000010:1.0:1767323548.028817:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d880. 02000000:00000010:1.0:1767323548.028831:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff9410065e6200. 00000100:00000010:1.0:1767323548.028844:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941008e72300. 02000000:00000010:1.0:1767323548.028884:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff941039950000. 00000400:00000010:1.0:1767323548.028895:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181562c0. 00000400:00000010:1.0:1767323548.028902:0:130258:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at ffff941008e726c0. 00000100:00000200:1.0:1767323548.028912:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1853171975835392, portal 25 00000400:00000010:1.0:1767323548.028918:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a7f8. 00000100:00000200:1.0:1767323548.028934:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1853171975835392, offset 0 00000400:00000200:1.0:1767323548.028943:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323548.028959:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323548.028966:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323548.028971:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323548.028976:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323548.028979:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323548.028982:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1445:1445:256:4294967295] 192.168.204.130@tcp LPNI seq info [1445:1445:8:4294967295] 00000400:00000200:1.0:1767323548.028994:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323548.029001:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323548.029006:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c000. 00000800:00000200:1.0:1767323548.029013:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323548.029023:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323548.029028:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c000 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:3.0:1767323548.029193:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323548.029199:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c000. 00000400:00000200:3.0:1767323548.029204:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323548.029210:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323548.029215:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a7f8 00000400:00000010:3.0:1767323548.029217:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a7f8. 00000100:00000200:3.0:1767323548.029225:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d880 x1853171975835392/t0(0) o503->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8416 e 0 to 0 dl 1767323564 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000010:3.0:1767323548.032693:0:130280:0:(lproc_ptlrpc.c:1375:ldebugfs_import_seq_write()) kmalloced '(kbuf)': 34 at ffff94100769ab80. 00000020:00000010:3.0:1767323548.032712:0:130280:0:(lproc_ptlrpc.c:1427:ldebugfs_import_seq_write()) kfreed 'kbuf': 34 at ffff94100769ab80. 00000400:00000200:3.0:1767323548.035197:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323548.035232:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 8416 into portal 25 MB=0x695733953cf00 00000400:00000200:3.0:1767323548.035245:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 8416/8416 into md 0x2f2d [4] + 224 00000400:00000200:3.0:1767323548.035268:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323548.035274:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:3.0:1767323548.035293:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d880 x1853171975835392/t0(0) o503->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8416 e 0 to 0 dl 1767323564 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323548.037676:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181562c0. 00000400:00000200:1.0:1767323548.037686:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008e726c0 00000400:00000010:1.0:1767323548.037689:0:130258:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 184 at ffff941008e726c0. 00000100:00000200:1.0:1767323548.037704:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d880 x1853171975835392/t0(0) o503->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8416 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323548.037717:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d880 x1853171975835392/t0(0) o503->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8416 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:1.0:1767323548.037753:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941008e72300. 02000000:00000010:1.0:1767323548.037771:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff941039950000. 02000000:00000010:1.0:1767323548.037787:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff9410065e6200. 00000100:00000010:1.0:1767323548.037795:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d880. 00000040:00000010:1.0:1767323548.037807:0:130258:0:(llog.c:945:llog_process_or_fork()) kmalloced '(lpi)': 96 at ffff941010de51e0. 00000020:00000010:0.0:1767323548.039889:0:130279:0:(lproc_ptlrpc.c:1375:ldebugfs_import_seq_write()) kmalloced '(kbuf)': 34 at ffff9410395e17c0. 00000020:00000010:0.0:1767323548.039905:0:130279:0:(lproc_ptlrpc.c:1427:ldebugfs_import_seq_write()) kfreed 'kbuf': 34 at ffff9410395e17c0. 00000020:00000010:0.0:1767323548.044658:0:130282:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff94100631e600. 00000020:00000010:0.0:1767323548.044673:0:130282:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff94100631fe00. 00000040:00000010:0.0:1767323548.044680:0:130282:0:(llog_obd.c:216:llog_key_init()) kmalloced '(value)': 480 at ffff94100631f600. 00000020:00000010:0.0:1767323548.044687:0:130282:0:(dt_object.c:32:dt_global_key_init()) kmalloced '(value)': 1264 at ffff9410202a4000. 00000020:00000010:0.0:1767323548.044694:0:130282:0:(tgt_main.c:719:tgt_key_init()) slab-alloced 'thread': 1288 at ffff941010bd0a10. 00000020:00000010:0.0:1767323548.044700:0:130282:0:(update_records.c:1195:update_key_init()) kmalloced '(value)': 432 at ffff941020055000. 80000000:00000010:0.0:1767323548.044707:0:130282:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at ffff941007ba21e0. 40000000:00000010:0.0:1767323548.044713:0:130282:0:(fid_handler.c:473:seq_key_init()) kmalloced '(value)': 48 at ffff9410395e17c0. 00100000:00000010:0.0:1767323548.044720:0:130282:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at ffff9410202a1000. 00040000:00000010:0.0:1767323548.044726:0:130282:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at ffff941005312a00. 00040000:00000010:0.0:1767323548.044732:0:130282:0:(qmt_dev.c:343:qmt_key_init()) kmalloced '(value)': 1256 at ffff9410202a7800. 00040000:00000010:0.0:1767323548.044737:0:130282:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at ffff941020055400. 00000004:00000010:0.0:1767323548.044743:0:130282:0:(mdd_device.c:2406:mdd_key_init()) kmalloced '(value)': 1872 at ffff9410202a0000. 00000004:00000010:0.0:1767323548.044758:0:130282:0:(mdt_handler.c:8363:mdt_key_init()) kmalloced '(value)': 2568 at ffff941004735000. 00000004:00000010:0.0:1767323548.044766:0:130282:0:(lod_dev.c:2338:lod_key_init()) kmalloced '(value)': 1224 at ffff9410202a6800. 00002000:00000010:0.0:1767323548.044772:0:130282:0:(ofd_dev.c:3000:ofd_key_init()) kmalloced '(value)': 816 at ffff94101090d000. 00000004:00000010:0.0:1767323548.044777:0:130282:0:(osp_dev.c:1816:osp_key_init()) kmalloced '(value)': 616 at ffff94101090f800. 00000020:00000010:0.0:1767323548.044784:0:130282:0:(lu_object.c:1956:lu_env_add_task()) kmalloced '(lei)': 40 at ffff9410395e1580. 00000040:00000010:0.0:1767323548.044796:0:130282:0:(llog.c:570:llog_process_thread()) kmalloced '(buf)': 8192 at ffff941039642000. 00000100:00000010:0.0:1767323548.044807:0:130282:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4e00. 02000000:00000010:0.0:1767323548.044826:0:130282:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff94100244b200. 00000100:00000010:0.0:1767323548.044847:0:130282:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941039a15a80. 02000000:00000010:0.0:1767323548.044887:0:130282:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff941007718000. 00000400:00000010:0.0:1767323548.044897:0:130282:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716370. 00000400:00000010:0.0:1767323548.044907:0:130282:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at ffff941039a15e40. 00000100:00000200:0.0:1767323548.044917:0:130282:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1853171975835520, portal 25 00000400:00000010:0.0:1767323548.045434:0:130282:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997d48. 00000100:00000200:0.0:1767323548.045439:0:130282:0:(niobuf.c:94:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1853171975835520, offset 0 00000400:00000200:0.0:1767323548.045452:0:130282:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323548.045471:0:130282:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323548.045479:0:130282:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323548.045485:0:130282:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323548.045489:0:130282:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323548.045493:0:130282:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323548.045497:0:130282:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1446:1446:256:4294967295] 192.168.204.130@tcp LPNI seq info [1446:1446:8:4294967295] 00000400:00000200:0.0:1767323548.045510:0:130282:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323548.045517:0:130282:0:(socklnd_cb.c:1001:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323548.045523:0:130282:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005312400. 00000800:00000200:0.0:1767323548.045532:0:130282:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323548.045541:0:130282:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323548.045547:0:130282:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005312400 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:1.0:1767323548.045685:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323548.045692:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005312400. 00000400:00000200:1.0:1767323548.045697:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323548.045704:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323548.045710:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997d48 00000400:00000010:1.0:1767323548.045713:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997d48. 00000100:00000200:1.0:1767323548.045724:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4e00 x1853171975835520/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323564 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1767323548.051452:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323548.051481:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 8472 into portal 25 MB=0x695733953cf80 00000400:00000200:2.0:1767323548.051493:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 8472/8472 into md 0x2f35 [4] + 224 00000400:00000200:2.0:1767323548.051518:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323548.051524:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:2.0:1767323548.051543:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4e00 x1853171975835520/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323564 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000010:0.0:1767323548.051804:0:130282:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716370. 00000400:00000200:0.0:1767323548.051810:0:130282:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039a15e40 00000400:00000010:0.0:1767323548.051813:0:130282:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 184 at ffff941039a15e40. 00000100:00000200:0.0:1767323548.051827:0:130282:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4e00 x1853171975835520/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323548.051838:0:130282:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4e00 x1853171975835520/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000010:0.0:1767323548.051873:0:130282:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941039a15a80. 02000000:00000010:0.0:1767323548.051889:0:130282:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff941007718000. 02000000:00000010:0.0:1767323548.051905:0:130282:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff94100244b200. 00000100:00000010:0.0:1767323548.051913:0:130282:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4e00. 00000020:00000010:0.0:1767323548.051950:0:130282:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941005312700. 00000020:00000010:0.0:1767323548.051955:0:130282:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941005312700. 00000020:00000010:0.0:1767323548.051962:0:130282:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 28 at ffff941041d91a20. 00000020:00000010:0.0:1767323548.051968:0:130282:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 112 at ffff941011b40e00. 00000020:00000010:0.0:1767323548.051976:0:130282:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 112 at ffff941011b40e00. 00000020:00000010:0.0:1767323548.051980:0:130282:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 28 at ffff941041d91a20. 00000020:00000010:0.0:1767323548.051985:0:130282:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941005312700. 00000020:00000010:0.0:1767323548.051987:0:130282:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941005312700. 00000020:00000010:0.0:1767323548.051991:0:130282:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941005312700. 00000020:00000010:0.0:1767323548.051993:0:130282:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941005312700. 00000020:00000010:0.0:1767323548.051996:0:130282:0:(obd_config.c:1895:class_config_llog_handler()) kmalloced '(inst_name)': 28 at ffff941041d91a20. 00000020:00000010:0.0:1767323548.051999:0:130282:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 112 at ffff941011b40e00. 00000020:00000010:0.0:1767323548.052072:0:130282:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 112 at ffff941011b40e00. 00000020:00000010:0.0:1767323548.052075:0:130282:0:(obd_config.c:1990:class_config_llog_handler()) kfreed 'inst_name': 28 at ffff941041d91a20. 00000100:00000010:0.0:1767323548.052085:0:130282:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4e00. 02000000:00000010:0.0:1767323548.052102:0:130282:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff941001342600. 00000100:00000010:0.0:1767323548.052116:0:130282:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941039a15a80. 02000000:00000010:0.0:1767323548.052153:0:130282:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 16384 at ffff941007718000. 00000400:00000010:0.0:1767323548.052159:0:130282:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716370. 00000400:00000010:0.0:1767323548.052164:0:130282:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at ffff941039a15e40. 00000100:00000200:0.0:1767323548.052173:0:130282:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 16384 bytes, xid 1853171975835648, portal 25 00000020:00000010:3.0:1767323548.052176:0:130281:0:(lproc_ptlrpc.c:1375:ldebugfs_import_seq_write()) kmalloced '(kbuf)': 34 at ffff94100769a8c0. 00000400:00000010:0.0:1767323548.052181:0:130282:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997550. 00000020:00000010:3.0:1767323548.052188:0:130281:0:(lproc_ptlrpc.c:1427:ldebugfs_import_seq_write()) kfreed 'kbuf': 34 at ffff94100769a8c0. 00000100:00000200:0.0:1767323548.052191:0:130282:0:(niobuf.c:94:ptl_send_buf()) Sending 272 bytes to portal 26, xid 1853171975835648, offset 0 00000400:00000200:0.0:1767323548.052201:0:130282:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323548.052213:0:130282:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323548.052220:0:130282:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323548.052227:0:130282:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323548.052231:0:130282:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323548.052234:0:130282:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323548.052239:0:130282:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1447:1447:256:4294967295] 192.168.204.130@tcp LPNI seq info [1447:1447:8:4294967295] 00000400:00000200:0.0:1767323548.052252:0:130282:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323548.052260:0:130282:0:(socklnd_cb.c:1001:ksocknal_send()) sending 272 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323548.052266:0:130282:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005312700. 00000800:00000200:0.0:1767323548.052275:0:130282:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323548.052285:0:130282:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323548.052290:0:130282:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005312700 type 1, nob 368 niov 1 nkiov 1 00000800:00000200:3.0:1767323548.054732:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323548.054746:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005312700. 00000400:00000200:3.0:1767323548.054755:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323548.054834:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323548.054844:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997550 00000400:00000010:3.0:1767323548.054847:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997550. 00000100:00000200:3.0:1767323548.054861:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4e00 x1853171975835648/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323564 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1767323548.054905:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323548.054930:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 8472 into portal 25 MB=0x695733953d000 00000400:00000200:3.0:1767323548.054939:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 8472/8472 into md 0x2f3d [4] + 224 00000400:00000200:3.0:1767323548.055028:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323548.055033:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:3.0:1767323548.055042:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4e00 x1853171975835648/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323564 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000400:00000010:3.0:1767323548.055087:0:130282:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716370. 00000400:00000200:3.0:1767323548.055091:0:130282:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039a15e40 00000400:00000010:3.0:1767323548.055094:0:130282:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 184 at ffff941039a15e40. 00000100:00000200:3.0:1767323548.055100:0:130282:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4e00 x1853171975835648/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323548.055109:0:130282:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4e00 x1853171975835648/t0(0) o502->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 272/8472 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000010:3.0:1767323548.055145:0:130282:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941039a15a80. 02000000:00000010:3.0:1767323548.055160:0:130282:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 16384 at ffff941007718000. 02000000:00000010:3.0:1767323548.055171:0:130282:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff941001342600. 00000100:00000010:3.0:1767323548.055179:0:130282:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4e00. 00000020:00000010:3.0:1767323548.055195:0:130282:0:(obd_config.c:1955:class_config_llog_handler()) kmalloced '(lcfg_new)': 200 at ffff941006cb3c00. 00000020:00000010:3.0:1767323548.055201:0:130282:0:(obd_config.c:1988:class_config_llog_handler()) kfreed 'lcfg_new': 200 at ffff941006cb3c00. 00000040:00000010:3.0:1767323548.055209:0:130282:0:(llog.c:891:llog_process_thread()) kvfree 'buf': 8192 at ffff941039642000. 00000020:00000010:3.0:1767323548.055220:0:130282:0:(lu_object.c:2001:lu_env_remove()) kfreed_rcu 'lei': 40 at ffff9410395e1580. 00000020:00000010:3.0:1767323548.055233:0:130282:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94100631fe00. 00000040:00000010:3.0:1767323548.055239:0:130282:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff94100631f600. 00000020:00000010:3.0:1767323548.055243:0:130282:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff9410202a4000. 00000020:00000010:3.0:1767323548.055250:0:130282:0:(tgt_main.c:739:tgt_key_fini()) slab-freed '(info)': 1288 at ffff941010bd0a10. 00000020:00000010:3.0:1767323548.055257:0:130282:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff941020055000. 80000000:00000010:3.0:1767323548.055262:0:130282:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff941007ba21e0. 40000000:00000010:3.0:1767323548.055268:0:130282:0:(fid_handler.c:473:seq_key_fini()) kfreed 'info': 48 at ffff9410395e17c0. 00100000:00000010:3.0:1767323548.055275:0:130282:0:(lfsck_lib.c:43:lfsck_key_fini()) kfreed 'info': 1800 at ffff9410202a1000. 00040000:00000010:3.0:1767323548.055280:0:130282:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 248 at ffff941005312a00. 00040000:00000010:3.0:1767323548.055285:0:130282:0:(qmt_dev.c:343:qmt_key_fini()) kfreed 'info': 1256 at ffff9410202a7800. 00040000:00000010:3.0:1767323548.055291:0:130282:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff941020055400. 00000004:00000010:3.0:1767323548.055297:0:130282:0:(mdd_device.c:2418:mdd_key_fini()) kfreed 'info': 1872 at ffff9410202a0000. 00000004:00000010:3.0:1767323548.055304:0:130282:0:(mdt_handler.c:8388:mdt_key_fini()) kfreed 'info': 2568 at ffff941004735000. 00000004:00000010:3.0:1767323548.055312:0:130282:0:(lod_dev.c:2364:lod_key_fini()) kfreed 'info': 1224 at ffff9410202a6800. 00002000:00000010:3.0:1767323548.055317:0:130282:0:(ofd_dev.c:3000:ofd_key_fini()) kfreed 'info': 816 at ffff94101090d000. 00000004:00000010:3.0:1767323548.055323:0:130282:0:(osp_dev.c:1816:osp_key_fini()) kfreed 'info': 616 at ffff94101090f800. 00000020:00000010:3.0:1767323548.055328:0:130282:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94100631e600. 00000040:00000010:1.0:1767323548.055733:0:130258:0:(llog.c:986:llog_process_or_fork()) kfreed 'lpi': 96 at ffff941010de51e0. 00000040:00000010:1.0:1767323548.055742:0:130258:0:(llog.c:70:llog_free_handle()) kvfree 'loghandle->lgh_hdr': 8192 at ffff941006a06000. 00000040:00000010:1.0:1767323548.055747:0:130258:0:(llog.c:72:llog_free_handle()) kfreed 'loghandle': 352 at ffff9410065e6e00. 00000020:00000010:1.0:1767323548.055753:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff94102030ec00. 00000040:00000010:1.0:1767323548.055757:0:130258:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff94102030f800. 00000020:00000010:1.0:1767323548.055760:0:130258:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff9410089e5800. 00000020:00000010:1.0:1767323548.055764:0:130258:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff941006171000. 80000000:00000010:1.0:1767323548.055768:0:130258:0:(fld_handler.c:35:fld_key_fini()) kfreed 'info': 72 at ffff941010de5d20. 00040000:00000010:1.0:1767323548.055771:0:130258:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff9410065e6000. 20000000:00000010:1.0:1767323548.055775:0:130258:0:(mgs_handler.c:1706:mgs_key_fini()) kfreed 'info': 392 at ffff9410065e6c00. 00000020:00000010:1.0:1767323548.055778:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff94102030f400. 10000000:00000010:1.0:1767323548.055781:0:130258:0:(mgc_request.c:1741:mgc_process_cfg_log()) kfreed 'env': 56 at ffff9410081d1900. 00000020:00000010:1.0:1767323548.055808:0:130258:0:(lu_object.c:532:lu_global_key_fini()) kfreed 'info': 512 at ffff941009993a00. 00000040:00000010:1.0:1767323548.055812:0:130258:0:(llog_obd.c:216:llog_key_fini()) kfreed 'info': 480 at ffff9410088ada00. 00000020:00000010:1.0:1767323548.055816:0:130258:0:(dt_object.c:33:dt_global_key_fini()) kfreed 'info': 1264 at ffff941005eba000. 00000020:00000010:1.0:1767323548.055820:0:130258:0:(update_records.c:1191:update_key_fini()) kfreed 'info': 432 at ffff9410088ace00. 00040000:00000010:1.0:1767323548.055823:0:130258:0:(lquota_lib.c:35:lquota_key_fini()) kfreed 'info': 248 at ffff941010ce9700. 00040000:00000010:1.0:1767323548.055827:0:130258:0:(qsd_lib.c:51:qsd_key_fini()) kfreed 'info': 408 at ffff9410088ac600. 00000020:00000010:1.0:1767323548.055830:0:130258:0:(lu_object.c:1648:keys_fini()) kfreed 'ctx->lc_value': 320 at ffff941009993200. 00000020:00000010:1.0:1767323548.055833:0:130258:0:(obd_mount.c:80:lustre_process_log()) kfreed 'lcfg': 184 at ffff9410398bdf00. 00000020:00000010:1.0:1767323548.055836:0:130258:0:(obd_mount.c:82:lustre_process_log()) kfreed 'bufs': 104 at ffff941011b40080. 00000080:00000010:1.0:1767323548.055846:0:130258:0:(llite_lib.c:1498:ll_fill_super()) kmalloced '(dt)': 33 at ffff9410081d1900. 00000080:00000010:1.0:1767323548.055850:0:130258:0:(llite_lib.c:1504:ll_fill_super()) kmalloced '(md)': 33 at ffff9410081d1e80. 00000080:00000010:1.0:1767323548.055859:0:130258:0:(llite_lib.c:348:client_common_fill_super()) kmalloced '(data)': 192 at ffff94103975d600. 00000080:00000010:1.0:1767323548.055862:0:130258:0:(llite_lib.c:352:client_common_fill_super()) kmalloced '(osfs)': 144 at ffff94103975d000. 00000020:00000010:1.0:1767323548.055878:0:130258:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff9410089e5800. 00000020:00000010:1.0:1767323548.055931:0:130258:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff9410089e6800. 00000400:00000200:1.0:1767323548.055951:0:130258:0:(peer.c:1581:LNetPeerDiscovered()) Peer NID 192.168.204.130@tcp is discovered: rc = 1 00000100:00000010:1.0:1767323548.055971:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d880. 02000000:00000010:1.0:1767323548.055987:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff941018351c00. 40000000:00000010:1.0:1767323548.056027:0:130258:0:(fid_request.c:432:client_fid_init()) kmalloced '(cli->cl_seq)': 224 at ffff941005b4cd00. 40000000:00000010:1.0:1767323548.056030:0:130258:0:(fid_request.c:436:client_fid_init()) kmalloced '(prefix)': 133 at ffff94103975d480. 40000000:00000010:1.0:1767323548.056095:0:130258:0:(fid_request.c:444:client_fid_init()) kfreed 'prefix': 133 at ffff94103975d480. 80000000:00000010:1.0:1767323548.056103:0:130258:0:(fld_request.c:150:fld_client_add_target()) kmalloced '(target)': 40 at ffff9410081d1300. 00020000:00000010:1.0:1767323548.056111:0:130258:0:(lu_tgt_descs.c:104:lu_qos_add_tgt()) kmalloced '(svr)': 104 at ffff941011986400. 00000100:00000010:1.0:1767323548.056120:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3ea00. 02000000:00000010:1.0:1767323548.056127:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c000. 00000020:00000010:1.0:1767323548.056156:0:130258:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff9410089e0800. 00000400:00000200:1.0:1767323548.056167:0:130258:0:(peer.c:1581:LNetPeerDiscovered()) Peer NID 192.168.204.130@tcp is discovered: rc = 1 00000100:00000010:1.0:1767323548.056173:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3df80. 02000000:00000010:1.0:1767323548.056178:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff941018353c00. 40000000:00000010:1.0:1767323548.056187:0:130258:0:(fid_request.c:432:client_fid_init()) kmalloced '(cli->cl_seq)': 224 at ffff941005b4ca00. 40000000:00000010:1.0:1767323548.056189:0:130258:0:(fid_request.c:436:client_fid_init()) kmalloced '(prefix)': 133 at ffff94103975d480. 40000000:00000010:1.0:1767323548.056223:0:130258:0:(fid_request.c:444:client_fid_init()) kfreed 'prefix': 133 at ffff94103975d480. 80000000:00000010:1.0:1767323548.056227:0:130258:0:(fld_request.c:150:fld_client_add_target()) kmalloced '(target)': 40 at ffff9410081d1080. 00000100:00000010:1.0:1767323548.056233:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3f800. 02000000:00000010:1.0:1767323548.056237:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cb00. 00800000:00000010:1.0:1767323548.056260:0:130258:0:(lmv_obd.c:1418:lmv_statfs()) kmalloced '(temp)': 144 at ffff94103975d480. 00000100:00000010:1.0:1767323548.056266:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3f100. 02000000:00000010:1.0:1767323548.056270:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c100. 00000100:00000010:1.0:1767323548.056276:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff94103975d9c0. 00000008:00000010:1.0:1767323548.056306:0:111000:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941007acc2f0. 00020000:00000010:1.0:1767323548.056312:0:111000:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410119bbd80. 00000008:00000010:1.0:1767323548.056319:0:111000:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff94103991b080. 00020000:00000010:1.0:1767323548.056324:0:111000:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410182ebcc0. 02000000:00000010:1.0:1767323548.056339:0:111000:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff941018350000. 00000400:00000010:1.0:1767323548.056345:0:111000:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181562c0. 00000400:00000010:1.0:1767323548.056357:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a4c8. 00000100:00000200:1.0:1767323548.056365:0:111000:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975835776, portal 10 00000020:00000010:1.0:1767323548.056375:0:111000:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941006a06000. 00000400:00000010:1.0:1767323548.056412:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890aaa0. 00000100:00000200:1.0:1767323548.056417:0:111000:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1853171975835776, offset 0 00000400:00000200:1.0:1767323548.056425:0:111000:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323548.056438:0:111000:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323548.056445:0:111000:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323548.056449:0:111000:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323548.056453:0:111000:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323548.056457:0:111000:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323548.056461:0:111000:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1448:1448:256:4294967295] 192.168.204.130@tcp LPNI seq info [1448:1448:8:4294967295] 00000400:00000200:1.0:1767323548.056472:0:111000:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323548.056478:0:111000:0:(socklnd_cb.c:1001:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323548.056484:0:111000:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c700. 00000800:00000200:1.0:1767323548.056491:0:111000:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323548.056499:0:111000:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323548.056504:0:111000:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c700 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:1.0:1767323548.056541:0:111000:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff941018351000. 00000400:00000010:1.0:1767323548.056545:0:111000:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181564d0. 00000400:00000010:1.0:1767323548.056549:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a088. 00000100:00000200:1.0:1767323548.056552:0:111000:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975836032, portal 10 00000020:00000010:1.0:1767323548.056560:0:111000:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941006a00000. 00000400:00000010:1.0:1767323548.056564:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a3b8. 00000100:00000200:1.0:1767323548.056567:0:111000:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1853171975836032, offset 0 00000400:00000200:1.0:1767323548.056572:0:111000:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323548.056577:0:111000:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323548.056580:0:111000:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323548.056583:0:111000:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323548.056585:0:111000:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323548.056587:0:111000:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323548.056597:0:111000:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1449:1449:255:4294967295] 192.168.204.130@tcp LPNI seq info [1449:1449:7:4294967295] 00000400:00000200:1.0:1767323548.056605:0:111000:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323548.056610:0:111000:0:(socklnd_cb.c:1001:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323548.056614:0:111000:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c900. 00000800:00000200:1.0:1767323548.056618:0:111000:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323548.056623:0:111000:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323548.056625:0:111000:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c900 type 1, nob 616 niov 1 nkiov 1 00000008:00000010:1.0:1767323548.056666:0:111004:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941007acd940. 00020000:00000010:1.0:1767323548.056670:0:111004:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410119bb540. 00000008:00000010:1.0:1767323548.056674:0:111004:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff94103991bb80. 00020000:00000010:1.0:1767323548.056678:0:111004:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410182e9680. 00000008:00000010:1.0:1767323548.056694:0:111003:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941007acce18. 00020000:00000010:1.0:1767323548.056698:0:111003:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410119bb180. 00000008:00000010:1.0:1767323548.056702:0:111003:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff94103991a6e0. 00020000:00000010:1.0:1767323548.056705:0:111003:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410182eb840. 00000008:00000010:1.0:1767323548.056716:0:111002:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941007ac8000. 00020000:00000010:1.0:1767323548.056719:0:111002:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff9410119bb0c0. 00000008:00000010:1.0:1767323548.056723:0:111002:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff94103991b340. 00020000:00000010:1.0:1767323548.056726:0:111002:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff9410182e8fc0. 00000800:00000200:1.0:1767323548.056770:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323548.056774:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c700. 00000400:00000200:1.0:1767323548.056778:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323548.056783:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323548.056788:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890aaa0 00000400:00000010:1.0:1767323548.056790:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890aaa0. 00000100:00000200:1.0:1767323548.056799:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d880 x1853171975835776/t0(0) o38->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 520/544 e 0 to 0 dl 1767323558 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000800:00000200:1.0:1767323548.056877:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323548.056880:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c900. 00000400:00000200:1.0:1767323548.056882:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323548.056886:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323548.056895:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a3b8 00000400:00000010:1.0:1767323548.056896:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a3b8. 00000100:00000200:1.0:1767323548.056902:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3df80 x1853171975836032/t0(0) o38->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 520/544 e 0 to 0 dl 1767323558 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000008:00000010:0.0:1767323548.059016:0:111001:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff941011afc2f0. 00020000:00000010:0.0:1767323548.059029:0:111001:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff941010a77840. 00000008:00000010:0.0:1767323548.059035:0:111001:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff941007532c60. 00020000:00000010:0.0:1767323548.059039:0:111001:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff941039749440. 00000400:00000200:3.0:1767323548.059675:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323548.059696:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 416 into portal 10 MB=0x695733953d080 00000400:00000200:3.0:1767323548.059706:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 416/416 into md 0x2f45 [1] + 0 00000400:00000200:3.0:1767323548.059721:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323548.059726:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:3.0:1767323548.059743:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d880 x1853171975835776/t0(0) o38->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1767323548.059805:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323548.059811:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 416 into portal 10 MB=0x695733953d180 00000400:00000200:3.0:1767323548.059817:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 416/416 into md 0x2f4d [1] + 0 00000400:00000200:3.0:1767323548.059826:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323548.059829:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:3.0:1767323548.059836:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3df80 x1853171975836032/t0(0) o38->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:0.0:1767323548.061084:0:111000:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181562c0. 00000400:00000200:0.0:1767323548.061097:0:111000:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a4c8 00000400:00000010:0.0:1767323548.061100:0:111000:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a4c8. 00000100:00000200:0.0:1767323548.061112:0:111000:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d880 x1853171975835776/t0(0) o38->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323548.061126:0:111000:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d880 x1853171975835776/t0(0) o38->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000010:0.0:1767323548.061153:0:111000:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941039640000. 00000400:00000010:0.0:1767323548.062000:0:111000:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181564d0. 00000400:00000200:0.0:1767323548.062009:0:111000:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a088 00000400:00000010:0.0:1767323548.062012:0:111000:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a088. 00000100:00000200:0.0:1767323548.062024:0:111000:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3df80 x1853171975836032/t0(0) o38->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323548.062055:0:111000:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3df80 x1853171975836032/t0(0) o38->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000010:0.0:1767323548.062074:0:111000:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941039644000. 02000000:00000010:0.0:1767323548.062143:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff94101090f800. 00000400:00000010:0.0:1767323548.062151:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107166e0. 00000400:00000010:0.0:1767323548.062157:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997b28. 00000100:00000200:0.0:1767323548.062167:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975835904, portal 10 00000400:00000010:0.0:1767323548.062174:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997088. 00000100:00000200:0.0:1767323548.062178:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975835904, offset 0 00000400:00000200:0.0:1767323548.062186:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323548.062202:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323548.062209:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323548.062215:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323548.062219:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323548.062223:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323548.062227:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1450:1450:256:4294967295] 192.168.204.130@tcp LPNI seq info [1450:1450:8:4294967295] 00000400:00000200:0.0:1767323548.062239:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323548.062247:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323548.062253:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005312a00. 00000800:00000200:0.0:1767323548.062261:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323548.062270:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323548.062276:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005312a00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1767323548.062471:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323548.062475:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005312a00. 00000400:00000200:0.0:1767323548.062480:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.062485:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323548.062490:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997088 00000400:00000010:0.0:1767323548.062492:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997088. 00000100:00000200:0.0:1767323548.062499:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3ea00 x1853171975835904/t0(0) o41->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 02000000:00000010:2.0:1767323548.062627:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff941008e98400. 00000400:00000010:2.0:1767323548.062634:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35c08. 00000400:00000010:2.0:1767323548.062639:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc34c8. 00000100:00000200:2.0:1767323548.062643:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975836288, portal 10 00000020:00000010:2.0:1767323548.062649:0:130258:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941007688000. 00000400:00000010:2.0:1767323548.062654:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3ee0. 00000100:00000200:2.0:1767323548.062656:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975836288, offset 0 00000400:00000200:2.0:1767323548.062661:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323548.062667:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323548.062670:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323548.062673:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323548.062677:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323548.062679:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323548.062682:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1451:1451:256:4294967295] 192.168.204.130@tcp LPNI seq info [1451:1451:8:4294967295] 00000400:00000200:2.0:1767323548.062689:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323548.062694:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323548.062699:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7700. 00000800:00000200:2.0:1767323548.062703:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323548.062708:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323548.062710:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7700 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:0.0:1767323548.062796:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323548.062799:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7700. 00000400:00000200:0.0:1767323548.062804:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.062808:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323548.062810:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3ee0 00000400:00000010:0.0:1767323548.062812:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3ee0. 00000100:00000200:0.0:1767323548.063051:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3f100 x1853171975836288/t0(0) o41->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 02000000:00000010:0.0:1767323548.063107:0:111000:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff941018350000. 02000000:00000010:0.0:1767323548.063114:0:111000:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at ffff941018351c00. 00000100:00000010:0.0:1767323548.063120:0:111000:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d880. 02000000:00000010:0.0:1767323548.063125:0:111000:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff941018351000. 02000000:00000010:0.0:1767323548.063127:0:111000:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at ffff941018353c00. 00000100:00000010:0.0:1767323548.063130:0:111000:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3df80. 02000000:00000010:3.0:1767323548.063644:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff941039c32c00. 00000400:00000010:3.0:1767323548.063652:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323548.063659:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec770. 00000100:00000200:3.0:1767323548.063664:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975836160, portal 10 00000020:00000010:3.0:1767323548.063672:0:111002:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941007318000. 00000400:00000010:3.0:1767323548.063678:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aeccc0. 00000100:00000200:3.0:1767323548.063682:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975836160, offset 0 00000400:00000200:3.0:1767323548.063690:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323548.063699:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323548.063703:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323548.063707:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323548.063710:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323548.063712:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323548.063716:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1452:1452:256:4294967295] 192.168.204.130@tcp LPNI seq info [1452:1452:8:4294967295] 00000400:00000200:3.0:1767323548.063725:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323548.063730:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323548.063736:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3c00. 00000800:00000200:3.0:1767323548.063741:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323548.063747:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323548.063750:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3c00 type 1, nob 320 niov 1 nkiov 1 00000800:00000200:2.0:1767323548.063979:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323548.063983:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3c00. 00000400:00000200:2.0:1767323548.063988:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323548.063993:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323548.063998:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aeccc0 00000400:00000010:2.0:1767323548.064001:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aeccc0. 00000100:00000200:2.0:1767323548.064010:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3f800 x1853171975836160/t0(0) o41->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323548.066492:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323548.066518:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 368 into portal 10 MB=0x695733953d100 00000400:00000200:0.0:1767323548.066529:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 368/368 into md 0x2f55 [1] + 224 00000400:00000200:0.0:1767323548.066544:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.066549:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323548.066563:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3ea00 x1853171975835904/t0(0) o41->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323548.066601:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323548.066609:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 368 into portal 10 MB=0x695733953d280 00000400:00000200:0.0:1767323548.066616:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 368/368 into md 0x2f5d [1] + 224 00000400:00000200:0.0:1767323548.066626:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.066630:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000010:3.0:1767323548.066631:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107166e0. 00000400:00000200:3.0:1767323548.066638:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997b28 00000400:00000010:3.0:1767323548.066641:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997b28. 00000100:00000200:3.0:1767323548.066650:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3ea00 x1853171975835904/t0(0) o41->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323548.066662:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3ea00 x1853171975835904/t0(0) o41->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 1 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000010:3.0:1767323548.066688:0:111004:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff94100731e000. 02000000:00000010:3.0:1767323548.066719:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff94101090f800. 02000000:00000010:3.0:1767323548.066726:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c000. 00000100:00000010:3.0:1767323548.066732:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3ea00. 00000100:00000200:0.0:1767323548.068246:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3f100 x1853171975836288/t0(0) o41->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323548.068365:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323548.068377:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 368 into portal 10 MB=0x695733953d200 00000400:00000200:0.0:1767323548.068399:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 368/368 into md 0x2f65 [1] + 224 00000400:00000200:0.0:1767323548.068414:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.068419:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323548.068427:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3f800 x1853171975836160/t0(0) o41->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:3.0:1767323548.068464:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:3.0:1767323548.068471:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec770 00000400:00000010:3.0:1767323548.068474:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec770. 00000100:00000200:3.0:1767323548.068482:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3f800 x1853171975836160/t0(0) o41->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323548.068492:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3f800 x1853171975836160/t0(0) o41->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 1 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 02000000:00000010:3.0:1767323548.068526:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff941039c32c00. 02000000:00000010:3.0:1767323548.068532:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cb00. 00000100:00000010:3.0:1767323548.068538:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3f800. 00000400:00000010:2.0:1767323548.068775:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35c08. 00000400:00000200:2.0:1767323548.068780:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc34c8 00000400:00000010:2.0:1767323548.068782:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc34c8. 00000100:00000200:2.0:1767323548.068790:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3f100 x1853171975836288/t0(0) o41->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323548.068799:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3f100 x1853171975836288/t0(0) o41->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:2.0:1767323548.068817:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff94103975d9c0. 02000000:00000010:2.0:1767323548.068824:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff941008e98400. 02000000:00000010:2.0:1767323548.068828:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c100. 00000100:00000010:2.0:1767323548.068830:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3f100. 00800000:00000010:2.0:1767323548.068838:0:130258:0:(lmv_obd.c:1478:lmv_statfs()) kfreed 'temp': 144 at ffff94103975d480. 00000100:00000010:3.0:1767323548.068896:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118eb480. 02000000:00000010:3.0:1767323548.068915:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff941010711400. 00000100:00000010:3.0:1767323548.068941:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941007428f00. 02000000:00000010:3.0:1767323548.068965:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff941039c32c00. 00000400:00000010:3.0:1767323548.069098:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323548.069103:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec770. 00000100:00000200:3.0:1767323548.069112:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975836416, portal 10 00000400:00000010:3.0:1767323548.069118:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aeca18. 00000100:00000200:3.0:1767323548.069122:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 440 bytes to portal 12, xid 1853171975836416, offset 0 00000400:00000200:3.0:1767323548.069137:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323548.069159:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323548.069166:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323548.069171:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323548.069175:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323548.069179:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323548.069183:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1453:1453:256:4294967295] 192.168.204.130@tcp LPNI seq info [1453:1453:8:4294967295] 00000400:00000200:3.0:1767323548.069195:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323548.069201:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 440 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323548.069208:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3000. 00000800:00000200:3.0:1767323548.069215:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323548.069224:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323548.069229:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3000 type 1, nob 536 niov 1 nkiov 1 00000800:00000200:0.0:1767323548.069515:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323548.069520:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3000. 00000400:00000200:0.0:1767323548.069526:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.069531:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323548.069534:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aeca18 00000400:00000010:0.0:1767323548.069537:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aeca18. 00000100:00000200:0.0:1767323548.069544:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118eb480 x1853171975836416/t0(0) o40->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 440/448 e 0 to 0 dl 1767323564 ref 3 fl Rpc:r/209/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1767323548.072536:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323548.072562:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 448 into portal 10 MB=0x695733953d300 00000400:00000200:2.0:1767323548.072572:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 448/448 into md 0x2f6d [1] + 224 00000400:00000200:2.0:1767323548.072592:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323548.072596:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:2.0:1767323548.072612:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118eb480 x1853171975836416/t0(0) o40->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 440/448 e 0 to 0 dl 1767323564 ref 2 fl Rpc:Qr/209/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:3.0:1767323548.072673:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:3.0:1767323548.072679:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec770 00000400:00000010:3.0:1767323548.072683:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec770. 00000100:00000200:3.0:1767323548.072692:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118eb480 x1853171975836416/t0(0) o40->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 440/448 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQ/209/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323548.072703:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118eb480 x1853171975836416/t0(0) o40->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 440/448 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQU/209/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:3.0:1767323548.072741:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941007428f00. 00000002:00000200:3.0:1767323548.072751:0:130258:0:(mdc_request.c:134:mdc_get_root()) root fid=[0x200000007:0x1:0x0], last_committed=0 02000000:00000010:3.0:1767323548.072840:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff941039c32c00. 02000000:00000010:3.0:1767323548.072849:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff941010711400. 00000100:00000010:3.0:1767323548.072855:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118eb480. 00000020:00000010:3.0:1767323548.072883:0:130258:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff9410201a9800. 00000020:00000010:3.0:1767323548.072908:0:130258:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff9410107ba800. 00000400:00000200:3.0:1767323548.072937:0:130258:0:(peer.c:1581:LNetPeerDiscovered()) Peer NID 192.168.204.130@tcp is discovered: rc = 1 00000100:00000010:3.0:1767323548.072957:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118eb480. 02000000:00000010:3.0:1767323548.073012:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff941039c32c00. 00000020:00000010:3.0:1767323548.073103:0:130258:0:(genops.c:952:__class_new_export()) kmalloced '(export)': 1208 at ffff9410107bd800. 00000400:00000200:3.0:1767323548.073115:0:130258:0:(peer.c:1581:LNetPeerDiscovered()) Peer NID 192.168.204.130@tcp is discovered: rc = 1 00000100:00000010:3.0:1767323548.073122:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118e9500. 02000000:00000010:3.0:1767323548.073128:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at ffff941039c30800. 00000080:00000010:3.0:1767323548.073147:0:130258:0:(llite_lib.c:734:client_common_fill_super()) kmalloced '(op_data)': 384 at ffff941010711400. 00000020:00000010:3.0:1767323548.073155:0:130258:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 640 at ffff941039c30c00. 00000100:00000010:3.0:1767323548.073167:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118e8e00. 02000000:00000010:3.0:1767323548.073172:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff941010710a00. 00000100:00000010:3.0:1767323548.073181:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff941007428f00. 02000000:00000010:3.0:1767323548.073200:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010711e00. 00000400:00000010:3.0:1767323548.073205:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323548.073210:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec770. 00000100:00000200:3.0:1767323548.073219:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975836800, portal 10 00000400:00000010:3.0:1767323548.073225:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec220. 00000100:00000200:3.0:1767323548.073228:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 264 bytes to portal 29, xid 1853171975836800, offset 0 00000400:00000200:3.0:1767323548.073235:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323548.073247:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323548.073253:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323548.073259:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323548.073263:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323548.073266:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323548.073271:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1454:1454:256:4294967295] 192.168.204.130@tcp LPNI seq info [1454:1454:8:4294967295] 00000400:00000200:3.0:1767323548.073282:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323548.073289:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 264 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323548.073295:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3400. 00000800:00000200:3.0:1767323548.073302:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323548.073311:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323548.073316:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3400 type 1, nob 360 niov 1 nkiov 1 02000000:00000010:0.0:1767323548.073474:0:111000:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff94101090d400. 00000400:00000010:0.0:1767323548.073481:0:111000:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716948. 00000400:00000010:0.0:1767323548.073486:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997088. 00000100:00000200:0.0:1767323548.073489:0:111000:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975836544, portal 4 00000020:00000010:0.0:1767323548.073496:0:111000:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941039646000. 00000400:00000010:0.0:1767323548.073501:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997908. 00000100:00000200:0.0:1767323548.073503:0:111000:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 28, xid 1853171975836544, offset 0 00000400:00000200:0.0:1767323548.073509:0:111000:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323548.073516:0:111000:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323548.073520:0:111000:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323548.073523:0:111000:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323548.073526:0:111000:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323548.073528:0:111000:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323548.073532:0:111000:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1455:1455:255:4294967295] 192.168.204.130@tcp LPNI seq info [1455:1455:7:4294967295] 00000400:00000200:0.0:1767323548.073548:0:111000:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323548.073553:0:111000:0:(socklnd_cb.c:1001:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323548.073558:0:111000:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005312a00. 00000800:00000200:0.0:1767323548.073562:0:111000:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323548.073567:0:111000:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323548.073569:0:111000:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005312a00 type 1, nob 616 niov 1 nkiov 1 02000000:00000010:0.0:1767323548.073591:0:111000:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at ffff94101090c800. 00000400:00000010:0.0:1767323548.073597:0:111000:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107161b8. 00000400:00000010:0.0:1767323548.073600:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997990. 00000100:00000200:0.0:1767323548.073603:0:111000:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1853171975836672, portal 4 00000020:00000010:0.0:1767323548.073610:0:111000:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941039642000. 00000400:00000010:0.0:1767323548.073615:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089977f8. 00000100:00000200:0.0:1767323548.073617:0:111000:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 28, xid 1853171975836672, offset 0 00000400:00000200:0.0:1767323548.073622:0:111000:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323548.073626:0:111000:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323548.073628:0:111000:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323548.073631:0:111000:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323548.073633:0:111000:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323548.073635:0:111000:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323548.073638:0:111000:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1456:1456:254:4294967295] 192.168.204.130@tcp LPNI seq info [1456:1456:6:4294967295] 00000400:00000200:0.0:1767323548.073645:0:111000:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323548.073649:0:111000:0:(socklnd_cb.c:1001:ksocknal_send()) sending 520 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323548.073652:0:111000:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005312700. 00000800:00000200:0.0:1767323548.073656:0:111000:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323548.073659:0:111000:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323548.073662:0:111000:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005312700 type 1, nob 616 niov 1 nkiov 1 00000800:00000200:0.0:1767323548.073717:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323548.073721:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3400. 00000400:00000200:0.0:1767323548.073727:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.073737:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323548.073741:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec220 00000400:00000010:0.0:1767323548.073743:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec220. 00000100:00000200:0.0:1767323548.073751:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118e8e00 x1853171975836800/t0(0) o900->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:29/10 lens 264/248 e 0 to 0 dl 1767323564 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000800:00000200:0.0:1767323548.073772:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323548.073775:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005312a00. 00000400:00000200:0.0:1767323548.073778:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.073781:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323548.073783:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997908 00000400:00000010:0.0:1767323548.073785:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997908. 00000100:00000200:0.0:1767323548.073790:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118eb480 x1853171975836544/t0(0) o8->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 1767323558 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000800:00000200:0.0:1767323548.073865:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323548.073869:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005312700. 00000400:00000200:0.0:1767323548.073872:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.073875:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323548.073878:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089977f8 00000400:00000010:0.0:1767323548.073879:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089977f8. 00000100:00000200:0.0:1767323548.073883:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118e9500 x1853171975836672/t0(0) o8->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 1767323558 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323548.087541:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323548.087567:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 416 into portal 4 MB=0x695733953d400 00000400:00000200:0.0:1767323548.087580:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.130@tcp of length 416/416 into md 0x2f85 [1] + 0 00000400:00000200:0.0:1767323548.087598:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.087603:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323548.087620:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118e9500 x1853171975836672/t0(0) o8->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323548.087660:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323548.087666:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 248 into portal 10 MB=0x695733953d480 00000400:00000200:0.0:1767323548.087681:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 248/248 into md 0x2f75 [1] + 224 00000400:00000200:0.0:1767323548.087689:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.087692:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323548.087700:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118e8e00 x1853171975836800/t0(0) o900->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:29/10 lens 264/248 e 0 to 0 dl 1767323564 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323548.087829:0:111000:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107161b8. 00000400:00000200:1.0:1767323548.087837:0:111000:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997990 00000400:00000010:1.0:1767323548.087840:0:111000:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997990. 00000100:00000200:1.0:1767323548.087847:0:111000:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118e9500 x1853171975836672/t0(0) o8->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323548.087857:0:111000:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118e9500 x1853171975836672/t0(0) o8->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000010:1.0:1767323548.087882:0:111000:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941006a04000. 02000000:00000010:1.0:1767323548.087969:0:111000:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff94101090c800. 02000000:00000010:1.0:1767323548.087977:0:111000:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at ffff941039c30800. 00000100:00000010:1.0:1767323548.087983:0:111000:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118e9500. 00000400:00000200:0.0:1767323548.088032:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323548.088039:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 416 into portal 4 MB=0x695733953d380 00000400:00000200:0.0:1767323548.088044:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.130@tcp of length 416/416 into md 0x2f7d [1] + 0 00000400:00000200:0.0:1767323548.088055:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.088059:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:0.0:1767323548.088066:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118eb480 x1853171975836544/t0(0) o8->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323548.090662:0:111000:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716948. 00000400:00000200:1.0:1767323548.090680:0:111000:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997088 00000400:00000010:1.0:1767323548.090683:0:111000:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997088. 00000100:00000200:1.0:1767323548.090701:0:111000:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118eb480 x1853171975836544/t0(0) o8->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323548.090715:0:111000:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118eb480 x1853171975836544/t0(0) o8->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 520/544 e 0 to 0 dl 1767323558 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000010:1.0:1767323548.090743:0:111000:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at ffff941006a02000. 02000000:00000010:1.0:1767323548.090816:0:111000:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at ffff94101090d400. 02000000:00000010:1.0:1767323548.090823:0:111000:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at ffff941039c32c00. 00000100:00000010:1.0:1767323548.090830:0:111000:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118eb480. 00000400:00000010:2.0:1767323548.091179:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:2.0:1767323548.091185:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec770 00000400:00000010:2.0:1767323548.091208:0:130258:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec770. 00000100:00000200:2.0:1767323548.091217:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118e8e00 x1853171975836800/t0(0) o900->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:29/10 lens 264/248 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323548.091227:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118e8e00 x1853171975836800/t0(0) o900->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:29/10 lens 264/248 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000010:2.0:1767323548.091249:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff941007428f00. 02000000:00000010:2.0:1767323548.091257:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010711e00. 02000000:00000010:2.0:1767323548.091260:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff941010710a00. 00000100:00000010:2.0:1767323548.091263:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118e8e00. 80000000:00000010:2.0:1767323548.091273:0:130258:0:(fld_cache.c:338:fld_cache_entry_create()) kmalloced '(f_new)': 56 at ffff941007605200. 00000020:00000010:2.0:1767323548.091285:0:130258:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 640 at ffff9410089f6400. 00000100:00000010:2.0:1767323548.091294:0:130258:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f13800. 02000000:00000010:2.0:1767323548.091310:0:130258:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at ffff941005b4ec00. 00000100:00000010:2.0:1767323548.091327:0:130258:0:(client.c:1157:ptlrpc_prep_set()) kmalloced '(set)': 144 at ffff94101094ef00. 02000000:00000010:2.0:1767323548.092526:0:130258:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 131072 at ffff9410076c0000. 00000400:00000010:2.0:1767323548.092547:0:130258:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35c08. 00000400:00000010:2.0:1767323548.092555:0:130258:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 632 at ffff9410089f7000. 00000100:00000200:2.0:1767323548.092565:0:130258:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 131072 bytes, xid 1853171975836928, portal 10 00000400:00000010:2.0:1767323548.092574:0:130258:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc34c8. 00000100:00000200:2.0:1767323548.092579:0:130258:0:(niobuf.c:94:ptl_send_buf()) Sending 448 bytes to portal 23, xid 1853171975836928, offset 0 00000400:00000200:2.0:1767323548.092590:0:130258:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323548.092609:0:130258:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323548.092617:0:130258:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323548.092623:0:130258:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323548.092628:0:130258:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323548.092632:0:130258:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323548.092636:0:130258:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1457:1457:256:4294967295] 192.168.204.130@tcp LPNI seq info [1457:1457:8:4294967295] 00000400:00000200:2.0:1767323548.092649:0:130258:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323548.092657:0:130258:0:(socklnd_cb.c:1001:ksocknal_send()) sending 448 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323548.092663:0:130258:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7600. 00000800:00000200:2.0:1767323548.092681:0:130258:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323548.092691:0:130258:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323548.092696:0:130258:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7600 type 1, nob 544 niov 1 nkiov 1 00000800:00000200:0.0:1767323548.096728:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323548.096741:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7600. 00000400:00000200:0.0:1767323548.096751:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323548.096762:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323548.096771:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc34c8 00000400:00000010:0.0:1767323548.096774:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc34c8. 00000100:00000200:0.0:1767323548.096788:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f13800 x1853171975836928/t0(0) o33->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:23/10 lens 448/66264 e 0 to 0 dl 1767323564 ref 3 fl Rpc:r/600/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:0 00000400:00000200:2.0:1767323548.114812:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323548.114840:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 464 into portal 10 MB=0x695733953d500 00000400:00000200:2.0:1767323548.114851:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 464/464 into md 0x2f8d [32] + 224 00000400:00000200:2.0:1767323548.114871:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323548.114877:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000200:2.0:1767323548.114895:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f13800 x1853171975836928/t0(0) o33->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:23/10 lens 448/66264 e 0 to 0 dl 1767323564 ref 2 fl Rpc:Qr/600/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:0 00000400:00000010:3.0:1767323548.115045:0:130258:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35c08. 00000400:00000200:3.0:1767323548.115051:0:130258:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089f7000 00000400:00000010:3.0:1767323548.115067:0:130258:0:(lib-lnet.h:315:lnet_md_free()) kfreed 'md': 632 at ffff9410089f7000. 00000100:00000200:3.0:1767323548.115074:0:130258:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f13800 x1853171975836928/t0(0) o33->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:23/10 lens 448/66264 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQ/600/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:0 00000100:00000200:3.0:1767323548.115084:0:130258:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f13800 x1853171975836928/t0(0) o33->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:23/10 lens 448/66264 e 0 to 0 dl 1767323564 ref 2 fl Rpc:RQU/600/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:0 00000100:00000010:3.0:1767323548.115121:0:130258:0:(client.c:3770:ptlrpc_reqset_free()) kfreed 'set': 144 at ffff94101094ef00. 00000002:00000200:3.0:1767323548.115130:0:130258:0:(mdc_request.c:172:mdc_getattr_common()) mode: 40755 00000080:00000010:3.0:1767323548.115136:0:130258:0:(llite_lib.c:749:client_common_fill_super()) kfreed 'op_data': 384 at ffff941010711400. 00000020:00000010:3.0:1767323548.115150:0:130258:0:(cl_object.c:714:cl_env_new()) slab-alloced 'cle': 144 at ffff9410181903f0. 00000020:00000010:3.0:1767323548.115156:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941010711400. 00000020:00000010:3.0:1767323548.115161:0:130258:0:(lu_object.c:532:lu_global_key_init()) kmalloced '(value)': 512 at ffff941010711c00. 00000020:00000010:3.0:1767323548.115165:0:130258:0:(cl_object.c:1136:cl_key_init()) kmalloced '(value)': 72 at ffff941039907240. 00000008:00000010:3.0:1767323548.115174:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff9410074de468. 00020000:00000010:3.0:1767323548.115179:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff941006a21000. 00008000:00000010:3.0:1767323548.115185:0:130258:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at ffff941006a3ade8. 00000020:00000010:3.0:1767323548.115190:0:130258:0:(lu_object.c:1715:keys_init()) kmalloced '(ctx->lc_value)': 320 at ffff941010710200. 00000008:00000010:3.0:1767323548.115194:0:130258:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff941007608160. 00020000:00000010:3.0:1767323548.115197:0:130258:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff941007471200. 00008000:00000010:3.0:1767323548.115201:0:130258:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at ffff941005beabb0. 00000080:00000010:3.0:1767323548.115206:0:130258:0:(vvp_dev.c:175:vvp_device_alloc()) kmalloced '(vdv)': 72 at ffff941039907120. 00000080:00000010:3.0:1767323548.115212:0:130258:0:(vvp_dev.c:183:vvp_device_alloc()) kmalloced '(site)': 528 at ffff941039c31800. 00000020:00000010:3.0:1767323548.115255:0:130258:0:(lu_object.c:1121:lu_site_init()) kmalloced '(s->ls_bkts)': 14336 at ffff941010a40000. 00000020:00000010:3.0:1767323548.115267:0:130258:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at ffff941039c31c00. 00000020:00000010:3.0:1767323548.115271:0:130258:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 192 at ffff941007428480. 00000008:00000010:3.0:1767323548.115280:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff9410074d8000. 00020000:00000010:3.0:1767323548.115283:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff941006a21f00. 00000080:00000010:3.0:1767323548.115287:0:130258:0:(vvp_dev.c:69:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff94101829df18. 00000080:00000010:3.0:1767323548.115292:0:130258:0:(vvp_dev.c:120:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff941039bc9240. 00000008:00000010:3.0:1767323548.115295:0:130258:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff941007608580. 00020000:00000010:3.0:1767323548.115298:0:130258:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff941007472880. 00000080:00000010:3.0:1767323548.115301:0:130258:0:(vvp_dev.c:95:vvp_session_key_init()) slab-alloced 'session': 240 at ffff941011929690. 00000008:00000010:3.0:1767323548.115306:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff9410074da178. 00020000:00000010:3.0:1767323548.115312:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff941006a21900. 00000080:00000010:3.0:1767323548.115315:0:130258:0:(vvp_dev.c:69:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff94101829dbd0. 00000080:00000010:3.0:1767323548.115317:0:130258:0:(vvp_dev.c:120:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff941039bcab58. 00000008:00000010:3.0:1767323548.115320:0:130258:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff9410076098c0. 00020000:00000010:3.0:1767323548.115323:0:130258:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff941007471d40. 00000080:00000010:3.0:1767323548.115326:0:130258:0:(vvp_dev.c:95:vvp_session_key_init()) slab-alloced 'session': 240 at ffff941011929b40. 00000008:00000010:3.0:1767323548.115330:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff9410074db7c8. 00020000:00000010:3.0:1767323548.115332:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff941006a216c0. 00000080:00000010:3.0:1767323548.115334:0:130258:0:(vvp_dev.c:69:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff94101829da80. 00000080:00000010:3.0:1767323548.115337:0:130258:0:(vvp_dev.c:120:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff941039bc8ff8. 00000008:00000010:3.0:1767323548.115340:0:130258:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff9410076086e0. 00020000:00000010:3.0:1767323548.115343:0:130258:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff941007470240. 00000080:00000010:3.0:1767323548.115345:0:130258:0:(vvp_dev.c:95:vvp_session_key_init()) slab-alloced 'session': 240 at ffff9410119292d0. 00000008:00000010:3.0:1767323548.115349:0:130258:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2856 at ffff9410074d8b28. 00020000:00000010:3.0:1767323548.115352:0:130258:0:(lov_dev.c:80:lov_key_init()) slab-alloced 'info': 192 at ffff941006a210c0. 00000080:00000010:3.0:1767323548.115355:0:130258:0:(vvp_dev.c:69:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff94101829ddc8. 00000080:00000010:3.0:1767323548.115357:0:130258:0:(vvp_dev.c:120:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff941039bc9b60. 00000008:00000010:3.0:1767323548.115360:0:130258:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at ffff941007609a20. 00020000:00000010:3.0:1767323548.115363:0:130258:0:(lov_dev.c:119:lov_session_key_init()) slab-alloced 'info': 576 at ffff941007473a80. 00000080:00000010:3.0:1767323548.115366:0:130258:0:(vvp_dev.c:95:vvp_session_key_init()) slab-alloced 'session': 240 at ffff9410119290f0. 00020000:00000010:3.0:1767323548.115375:0:130258:0:(lovsub_dev.c:89:lovsub_device_alloc()) kmalloced '(lsd)': 72 at ffff9410399076c0. 00020000:00000010:3.0:1767323548.115409:0:130258:0:(lovsub_dev.c:89:lovsub_device_alloc()) kmalloced '(lsd)': 72 at ffff941039907360. 00020000:00000010:3.0:1767323548.115415:0:130258:0:(lovsub_dev.c:89:lovsub_device_alloc()) kmalloced '(lsd)': 72 at ffff941039907b40. 00020000:00000010:3.0:1767323548.115419:0:130258:0:(lovsub_dev.c:89:lovsub_device_alloc()) kmalloced '(lsd)': 72 at ffff941039907d20. 00000080:00000010:3.0:1767323548.115443:0:130258:0:(super25.c:43:ll_alloc_inode()) slab-alloced 'lli': 2072 at ffff94102fa22940. 02000000:00000010:3.0:1767323548.115471:0:130258:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 131072 at ffff9410076c0000. 02000000:00000010:3.0:1767323548.115496:0:130258:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at ffff941005b4ec00. 00000100:00000010:3.0:1767323548.115501:0:130258:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f13800. 00000080:00000010:3.0:1767323548.115511:0:130258:0:(dcache.c:138:ll_d_init()) kmalloced '(lld)': 24 at ffff94103b623d40. 00000080:00000010:3.0:1767323548.115520:0:130258:0:(llite_lib.c:838:client_common_fill_super()) kfreed 'data': 192 at ffff94103975d600. 00000080:00000010:3.0:1767323548.115523:0:130258:0:(llite_lib.c:839:client_common_fill_super()) kfreed 'osfs': 144 at ffff94103975d000. 00000080:00000010:3.0:1767323548.115553:0:130258:0:(llite_lib.c:1517:ll_fill_super()) kfreed 'md': 33 at ffff9410081d1e80. 00000080:00000010:3.0:1767323548.115558:0:130258:0:(llite_lib.c:1519:ll_fill_super()) kfreed 'dt': 33 at ffff9410081d1900. 00000080:00000010:3.0:1767323548.115566:0:130258:0:(llite_lib.c:1527:ll_fill_super()) kfreed 'cfg': 88 at ffff941007ba2720. 00000080:02000400:3.0:1767323548.115569:0:130258:0:(llite_lib.c:1533:ll_fill_super()) Mounted lustre-client 00000080:00200008:1.0:1767323548.237346:0:130301:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff94102fa22a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1767323548.237362:0:130301:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08),name=/ 00000002:00010000:1.0:1767323548.237508:0:130301:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1767323548.237592:0:130301:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 130301 initiator: MDT0 00010000:00010000:1.0:1767323548.237603:0:130301:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 130301 initiator: MDT0 00010000:00010000:1.0:1767323548.237615:0:130301:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 130301 initiator: MDT0 00000100:00100000:1.0:1767323548.237648:0:130301:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3e300 pname:cluuid:pid:xid:nid:opc:job mkdir:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130301:1853171975837056:192.168.204.130@tcp:101:mkdir.0 00000100:00100000:1.0:1767323548.237811:0:130301:0:(client.c:2690:ptlrpc_set_wait()) set ffff94103975d780 going to sleep for 11 seconds 00000100:00100000:2.0:1767323548.243124:0:130301:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3e300 pname:cluuid:pid:xid:nid:opc:job mkdir:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130301:1853171975837056:192.168.204.130@tcp:101:mkdir.0 00010000:00010000:2.0:1767323548.243157:0:130301:0:(ldlm_request.c:702:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.243170:0:130301:0:(ldlm_request.c:730:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.243185:0:130301:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.243203:0:130301:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.243217:0:130301:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.243226:0:130301:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.243255:0:130301:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1767323548.243268:0:130301:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff941010e3e300 x1853171975837056/t0(0) o101->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 576/688 e 0 to 0 dl 1767323564 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1767323548.243283:0:130301:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.243299:0:130301:0:(ldlm_lock.c:1532:ldlm_lock_match_with_skip()) ### not matched ns ffff94101076c800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1767323548.243307:0:130301:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1767323548.243339:0:130301:0:(llite_lib.c:2981:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1767323548.243344:0:130301:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff94102fa22a08) for lock 0x720c8b170b55697f 00000080:00010000:2.0:1767323548.243350:0:130301:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff94102fa22a08) 00000080:00010000:2.0:1767323548.243354:0:130301:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55697f from it ffffb7548a493cb8 00010000:00010000:2.0:1767323548.243357:0:130301:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.243365:0:130301:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323548.937729:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323549.959614:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:3.0:1767323550.102361:0:130353:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff94102fa22a08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1767323550.102375:0:130353:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08),name=/ 00000002:00010000:3.0:1767323550.102417:0:130353:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323550.102434:0:130353:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323550.102451:0:130353:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323550.102459:0:130353:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323550.102466:0:130353:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff94102fa22a08) 00000080:00010000:3.0:1767323550.102469:0:130353:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff94102fa22a08) for lock 0x720c8b170b55697f 00000080:00010000:3.0:1767323550.102476:0:130353:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55697f from it ffffb75480d53cb8 00010000:00010000:3.0:1767323550.102480:0:130353:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323550.102489:0:130353:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1767323550.103040:0:130353:0:(file.c:6252:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff94102fa22a08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1767323550.103045:0:130353:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08),name=/ 00000002:00010000:3.0:1767323550.103054:0:130353:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323550.103061:0:130353:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323550.103071:0:130353:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323550.103086:0:130353:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323550.103090:0:130353:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff94102fa22a08) 00000080:00010000:3.0:1767323550.103093:0:130353:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff94102fa22a08) for lock 0x720c8b170b55697f 00000080:00010000:3.0:1767323550.103098:0:130353:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55697f from it ffffb75480d53cb8 00010000:00010000:3.0:1767323550.103101:0:130353:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323550.103108:0:130353:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323550.103197:0:130353:0:(file.c:6147:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08),name=/ 00000002:00010000:3.0:1767323550.103206:0:130353:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1767323550.103212:0:130353:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323550.103219:0:130353:0:(ldlm_lock.c:1515:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323550.103225:0:130353:0:(namei.c:955:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1767323550.103229:0:130353:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff94102fa22a08) 00000080:00010000:3.0:1767323550.103231:0:130353:0:(llite_internal.h:2004:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff94102fa22a08) for lock 0x720c8b170b55697f 00000080:00010000:3.0:1767323550.103235:0:130353:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x720c8b170b55697f from it ffffb75480d53bb0 00010000:00010000:3.0:1767323550.103238:0:130353:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323550.103244:0:130353:0:(ldlm_lock.c:905:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9410201aa800 lock: ffff941018107e00/0x720c8b170b55697f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x6f7fea81d46fe777 expref: -99 pid: 130301 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1767323550.103273:0:130353:0:(file.c:6629:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08), inode mode 41ed mask 44 00000080:00200008:3.0:1767323550.103282:0:130353:0:(file.c:1001:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff94102fa22a08), flags 100000 00000080:00200080:3.0:1767323550.103373:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.103407:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00800000:00000004:3.0:1767323550.103416:0:130353:0:(obd_class.h:1083:obd_statfs()) lustre-MDT0000-mdc-ffff9410201aa800: age 6097, max_age 6098 00000100:00100000:3.0:1767323550.103457:0:130353:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job lfs:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130353:1853171975837184:192.168.204.130@tcp:41:lfs.0 00000100:00100000:3.0:1767323550.103554:0:130353:0:(client.c:2690:ptlrpc_set_wait()) set ffff941003e9a000 going to sleep for 11 seconds 00000100:00100000:3.0:1767323550.108985:0:130353:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job lfs:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130353:1853171975837184:192.168.204.130@tcp:41:lfs.0 00800000:00000004:3.0:1767323550.109019:0:130353:0:(obd_class.h:1109:obd_statfs()) lustre-MDT0000-mdc-ffff9410201aa800: update ffff941007728370 cache blocks 8948/10876 objects 39717/40000 00000080:00200080:3.0:1767323550.109167:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.109186:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00800000:00000004:3.0:1767323550.109196:0:130353:0:(obd_class.h:1083:obd_statfs()) lustre-MDT0001-mdc-ffff9410201aa800: age 5097, max_age 6098 00000100:00100000:3.0:1767323550.109236:0:130353:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job lfs:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130353:1853171975837312:192.168.204.130@tcp:41:lfs.0 00000100:00100000:3.0:1767323550.109326:0:130353:0:(client.c:2690:ptlrpc_set_wait()) set ffff941003e9a000 going to sleep for 11 seconds 00010000:00080000:3.0:1767323550.113804:0:130353:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9410118e9c00 x1853171975837312/t0(0) o41->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/368 e 0 to 0 dl 1767323566 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323550.113823:0:130353:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job lfs:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130353:1853171975837312:192.168.204.130@tcp:41:lfs.0 00800000:00000004:3.0:1767323550.113850:0:130353:0:(obd_class.h:1109:obd_statfs()) lustre-MDT0001-mdc-ffff9410201aa800: update ffff94100772e6d0 cache blocks 8989/10876 objects 39742/40000 00000080:00200080:3.0:1767323550.113939:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.113956:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.113964:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.113968:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.113988:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.113992:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.113996:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114000:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114004:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114008:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114011:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114015:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114019:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114022:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114026:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114030:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114034:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114037:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114041:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114044:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114048:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114051:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114055:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114058:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114062:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114065:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114069:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114073:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114077:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114086:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114091:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114095:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114099:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114102:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114106:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114109:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114113:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114116:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114119:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114123:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114126:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114129:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114133:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114136:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114140:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114143:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114147:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114150:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114154:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114157:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114161:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114165:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114168:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114171:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114182:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114186:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114190:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114193:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114197:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114201:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114205:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114209:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114213:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114216:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114220:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114223:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114227:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114231:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114235:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114238:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114241:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114244:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114248:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114252:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114255:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114259:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114274:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114279:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114283:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114293:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114299:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114303:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114307:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114310:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114314:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114318:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114322:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114325:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114329:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114332:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114336:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114339:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114343:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114347:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114351:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114354:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114358:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114362:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114366:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114369:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114373:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114376:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114380:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114426:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114437:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114442:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114445:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114449:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114453:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114456:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114461:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114464:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114469:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114472:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114477:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114480:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114485:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114488:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114492:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114496:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114500:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114503:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114507:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114511:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114514:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00800000:00000080:3.0:1767323550.114517:0:130353:0:(lmv_obd.c:905:lmv_iocontrol()) lustre-clilmv-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.114520:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.114526:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00020000:00000004:3.0:1767323550.114533:0:130353:0:(obd_class.h:1083:obd_statfs()) lustre-OST0000-osc-ffff9410201aa800: age 5097, max_age 6098 00000100:00100000:3.0:1767323550.114573:0:130353:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job lfs:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130353:1853171975837440:192.168.204.130@tcp:13:lfs.0 00000100:00100000:3.0:1767323550.114656:0:130353:0:(client.c:2690:ptlrpc_set_wait()) set ffff941003e9a000 going to sleep for 11 seconds 00000100:00100000:3.0:1767323550.120978:0:130353:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job lfs:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130353:1853171975837440:192.168.204.130@tcp:13:lfs.0 00020000:00000004:3.0:1767323550.121009:0:130353:0:(obd_class.h:1109:obd_statfs()) lustre-OST0000-osc-ffff9410201aa800: update ffff94100772cdf8 cache blocks 15594/17769 objects 24595/25000 00000080:00200080:3.0:1767323550.121140:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.121160:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00020000:00000004:3.0:1767323550.121170:0:130353:0:(obd_class.h:1083:obd_statfs()) lustre-OST0001-osc-ffff9410201aa800: age 5097, max_age 6098 00000100:00100000:3.0:1767323550.121212:0:130353:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job lfs:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130353:1853171975837568:192.168.204.130@tcp:13:lfs.0 00000100:00100000:3.0:1767323550.121343:0:130353:0:(client.c:2690:ptlrpc_set_wait()) set ffff941003e9a000 going to sleep for 11 seconds 00000100:00100000:3.0:1767323550.127485:0:130353:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e9c00 pname:cluuid:pid:xid:nid:opc:job lfs:266cb04f-2455-4d17-9fb2-b78bc8e504ec:130353:1853171975837568:192.168.204.130@tcp:13:lfs.0 00020000:00000004:3.0:1767323550.127518:0:130353:0:(obd_class.h:1109:obd_statfs()) lustre-OST0001-osc-ffff9410201aa800: update ffff941039c53520 cache blocks 15629/17769 objects 24632/25000 00000080:00200080:3.0:1767323550.127591:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127609:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127616:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127621:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127625:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127628:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127632:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127635:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127639:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127643:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127647:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127651:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127654:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127675:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127680:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127684:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127688:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127691:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127695:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127698:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127702:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127705:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127709:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127712:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127716:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127719:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127722:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127726:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127730:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127733:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127737:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127740:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127749:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127752:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127756:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127759:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127763:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127765:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127777:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127781:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127785:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127788:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127791:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127795:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127798:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127802:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127805:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127809:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127813:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127816:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127820:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127824:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127828:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127831:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127835:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127838:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127843:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127846:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127850:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127853:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127857:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127861:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127865:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127875:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127890:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127895:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127899:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127903:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127907:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127910:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127913:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127917:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127920:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127923:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127926:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127930:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127933:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127937:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127941:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127944:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127947:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127951:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127954:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127957:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127961:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127965:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127969:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127973:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127983:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127987:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127991:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.127994:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.127997:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128001:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128005:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128008:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128012:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128016:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128019:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128023:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128026:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128030:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128034:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128037:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128041:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128045:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128049:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128052:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128055:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128058:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128062:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128065:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128068:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128080:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128085:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128088:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128092:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128095:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128098:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128102:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128105:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128108:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128111:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128114:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200080:3.0:1767323550.128117:0:130353:0:(dir.c:2017:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff94102fa22a08) cmd=c00866a4 arg=7fffe0151590 00020000:00000080:3.0:1767323550.128120:0:130353:0:(lov_obd.c:958:lov_iocontrol()) lustre-clilov-ffff9410201aa800: cmd=c00866a4 len=592 karg=ffff941039c33c00 uarg=0000000000000000 00000080:00200008:3.0:1767323550.128137:0:130353:0:(file.c:424:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff94102fa22a08), flags 100000 00010000:00010000:2.0:1767323550.985849:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323552.008545:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1767323552.256101:0:130548:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1767323553.031572:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323553.482636:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975837696:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323553.482729:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975838208:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323553.482759:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1767323553.482765:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975838080:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323553.483715:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975837952:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323553.483770:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1767323553.483777:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975837824:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323553.491964:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975837824:192.168.204.130@tcp:400:kworker.0 00010000:00080000:3.0:1767323553.491997:0:111004:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941039f10000 x1853171975837952/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323553.492009:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975837952:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323553.498771:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975838080:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323553.498800:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975837696:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323553.498809:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975838208:192.168.204.130@tcp:400:kworker.0 00010000:00010000:0.0:1767323554.055587:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767323555.070198:0:110994:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.130@tcp (source: 12345-192.168.204.130@tcp) 00000100:00100000:2.0:1767323555.070282:0:130260:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853172047323264 00000100:00100000:2.0:1767323555.070294:0:130260:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853172047323264 00000100:00100000:2.0:1767323555.070365:0:130260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.130@tcp, seq: 0 00000100:00100000:2.0:1767323555.070377:0:130260:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9410118e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a00b263e-ee70-4193-8137-db92c096fca5+3:288575:x1853172047323264:12345-192.168.204.130@tcp:104: 00010000:00010000:2.0:1767323555.070448:0:130260:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.130@tcp lock: ffff941018106000/0x720c8b170b55694e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6f7fea81d46fe74d expref: -99 pid: 130258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323555.070549:0:130260:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1767323555.070557:0:130260:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9410118e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a00b263e-ee70-4193-8137-db92c096fca5+3:288575:x1853172047323264:12345-192.168.204.130@tcp:104: Request processed in 183us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1767323555.070565:0:130260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.130@tcp, seq: 0 00010000:00010000:3.0:1767323555.070637:0:130265:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1767323555.070645:0:130265:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.130@tcp lock: ffff941018106000/0x720c8b170b55694e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6f7fea81d46fe74d expref: -99 pid: 130258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323555.070653:0:130265:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff941018106000 already unused, calling callback (ffffffffc13ecc20) 10000000:00010000:3.0:1767323555.070658:0:130265:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.130@tcp lock: ffff941018106000/0x720c8b170b55694e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6f7fea81d46fe74d expref: -99 pid: 130258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323555.070677:0:130265:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.130@tcp lock: ffff941018106000/0x720c8b170b55694e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6f7fea81d46fe74d expref: -99 pid: 130258 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1767323555.070685:0:130265:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.130@tcp lock: ffff941018106000/0x720c8b170b55694e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6f7fea81d46fe74d expref: -99 pid: 130258 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1767323555.070691:0:130265:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1767323555.070779:0:130265:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.130@tcp lock: ffff941018106000/0x720c8b170b55694e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6f7fea81d46fe74d expref: -99 pid: 130258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323555.070786:0:130265:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1767323555.070829:0:130265:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.130@tcp lock: ffff941018106000/0x720c8b170b55694e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6f7fea81d46fe74d expref: -99 pid: 130258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323555.070837:0:130265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.130@tcp lock: ffff941018106000/0x720c8b170b55694e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6f7fea81d46fe74d expref: -99 pid: 130258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767323555.070859:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323555.070868:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323555.070869:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767323555.070891:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975838336:192.168.204.130@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1767323555.076898:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975838336:192.168.204.130@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1767323555.079507:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323556.103643:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1767323556.167530:0:130267:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1767323556.167540:0:130267:0:(mgc_request.c:1812:mgc_process_log()) Process log params-ffff9410201aa800 from 7 10000000:01000000:2.0:1767323556.167546:0:130267:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1767323556.167612:0:130267:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.130@tcp lock: ffff941006a33e00/0x720c8b170b556986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 130267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323556.167627:0:130267:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.130@tcp lock: ffff941006a33e00/0x720c8b170b556986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 130267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323556.167640:0:130267:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.130@tcp lock: ffff941006a33e00/0x720c8b170b556986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 130267 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767323556.167677:0:130267:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a00b263e-ee70-4193-8137-db92c096fca5:130267:1853171975838464:192.168.204.130@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1767323556.167819:0:130267:0:(client.c:2690:ptlrpc_set_wait()) set ffff941007428840 going to sleep for 11 seconds 00000100:00100000:2.0:1767323556.171361:0:130267:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a00b263e-ee70-4193-8137-db92c096fca5:130267:1853171975838464:192.168.204.130@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1767323556.171440:0:130267:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.130@tcp lock: ffff941006a33e00/0x720c8b170b556986 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6f7fea81d46fe785 expref: -99 pid: 130267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323556.171456:0:130267:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.130@tcp lock: ffff941006a33e00/0x720c8b170b556986 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6f7fea81d46fe785 expref: -99 pid: 130267 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767323556.171560:0:130267:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a00b263e-ee70-4193-8137-db92c096fca5:130267:1853171975838592:192.168.204.130@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1767323556.171685:0:130267:0:(client.c:2690:ptlrpc_set_wait()) set ffff941007428840 going to sleep for 11 seconds 00000100:00100000:2.0:1767323556.177066:0:130267:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a00b263e-ee70-4193-8137-db92c096fca5:130267:1853171975838592:192.168.204.130@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1767323556.177152:0:130267:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a00b263e-ee70-4193-8137-db92c096fca5:130267:1853171975838720:192.168.204.130@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1767323556.177332:0:130267:0:(client.c:2690:ptlrpc_set_wait()) set ffff941007428840 going to sleep for 11 seconds 00000100:00100000:2.0:1767323556.184923:0:130267:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a00b263e-ee70-4193-8137-db92c096fca5:130267:1853171975838720:192.168.204.130@tcp:503:ll_cfg_requeue.0 00000040:00080000:1.0:1767323556.186612:0:130730:0:(llog.c:854:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1767323556.187196:0:130267:0:(obd_config.c:2043:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1767323556.187217:0:130267:0:(mgc_request.c:1889:mgc_process_log()) MGC192.168.204.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1767323556.187229:0:130267:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.130@tcp lock: ffff941006a33e00/0x720c8b170b556986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6f7fea81d46fe785 expref: -99 pid: 130267 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767323556.187241:0:130267:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.130@tcp lock: ffff941006a33e00/0x720c8b170b556986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6f7fea81d46fe785 expref: -99 pid: 130267 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767323557.127587:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767323558.156849:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767323558.600187:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975838976:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323558.600312:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767323558.600320:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975839104:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323558.600781:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975838848:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323558.600844:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975839360:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323558.600849:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975839232:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323558.604887:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975839232:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323558.605067:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975838848:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323558.605080:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975839360:192.168.204.130@tcp:400:kworker.0 00010000:00080000:2.0:1767323558.605304:0:111001:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be7b80 x1853171975839104/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323558.605317:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975839104:192.168.204.130@tcp:400:kworker.0 00000100:00100000:2.0:1767323558.605329:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975838976:192.168.204.130@tcp:400:kworker.0 00010000:00010000:0.0:1767323559.175836:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323560.201054:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323561.224418:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767323562.253769:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767323563.279948:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767323563.721919:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975839488:192.168.204.130@tcp:400:kworker.0 00000100:00100000:1.0:1767323563.722340:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975839616:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323563.724609:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975839488:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323563.725437:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975839744:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323563.729737:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975839616:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323563.730131:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1767323563.730158:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975839872:192.168.204.130@tcp:400:kworker.0 00000100:00100000:3.0:1767323563.732278:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767323563.732309:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975840000:192.168.204.130@tcp:400:kworker.0 00010000:00080000:0.0:1767323563.733999:0:111003:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941039f11f80 x1853171975839744/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323563.734024:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975839744:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323563.734057:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975839872:192.168.204.130@tcp:400:kworker.0 00000100:00100000:0.0:1767323563.738033:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975840000:192.168.204.130@tcp:400:kworker.0 00010000:00000001:0.0:1767323564.295813:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323564.295823:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323564.295830:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323564.295831:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323564.295878:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323564.295881:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323564.295884:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323565.000312:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300781807, at 4300781824 00000100:00000010:2.0:1767323565.000335:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907a80. 00000100:00000040:3.0:1767323565.000465:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300781807, at 4300781825 00000100:00000010:3.0:1767323565.000472:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907060. 00000100:00000040:0.0:1767323565.001297:0:127095:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300781807, at 4300781825 00000100:00000010:0.0:1767323565.001308:0:127095:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907c00. 00000100:00000040:1.0:1767323565.001670:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300781807, at 4300781826 00000100:00000010:1.0:1767323565.001685:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907780. 00010000:00000001:0.0:1767323565.319544:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323565.319555:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323565.319563:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323565.319566:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323565.319698:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323565.319702:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323565.319706:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323566.343481:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323566.343488:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323566.343493:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323566.343494:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323566.343540:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323566.343542:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323566.343545:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323567.367509:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323567.367515:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323567.367521:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323567.367522:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323567.367921:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323567.367925:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323567.367928:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323568.391524:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323568.391533:0:127095:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323568.391535:0:127095:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323568.391537:0:127095:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323568.391542:0:127095:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323568.391554:0:127095:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323568.391556:0:127095:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323568.391558:0:127095:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323568.391562:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323568.391563:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323568.391587:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323568.391590:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323568.391593:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323568.839839:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323568.839857:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323568.839869:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3e680. 00000020:00000040:1.0:1767323568.839875:0:8:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:1.0:1767323568.839881:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323568.839892:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323568.839898:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323568.839908:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c100. 00000100:00000001:1.0:1767323568.839915:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.839926:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323568.839936:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323568.839940:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.840122:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ca7d5046] to pc [ptlrpcd_00_01+1] req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.840161:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.840165:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323568.840168:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323568.840172:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3dc00. 00000020:00000040:1.0:1767323568.840175:0:8:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323568.840177:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323568.840179:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323568.840181:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323568.840184:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cb00. 00000100:00000001:1.0:1767323568.840188:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.840208:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323568.840215:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323568.840217:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.840220:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000de5b7bd2] to pc [ptlrpcd_00_02+2] req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.840253:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.840255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323568.840258:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323568.840262:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3c000. 00000020:00000040:1.0:1767323568.840265:0:8:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323568.840267:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323568.840268:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323568.840270:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323568.840274:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c000. 00000100:00000001:1.0:1767323568.840277:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.840281:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323568.840288:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323568.840290:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.840293:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005ecea4d9] to pc [ptlrpcd_00_03+3] req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.840301:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.840303:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323568.840306:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323568.840309:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d500. 00000020:00000040:1.0:1767323568.840312:0:8:0:(genops.c:1229:class_import_get()) import ffff941007818000 refcount=3 obd=lustre-OST0000-osc-ffff9410201aa800 00000100:00000001:1.0:1767323568.840314:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323568.840315:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323568.840317:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323568.840328:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c700. 00000100:00000001:0.0:1767323568.840583:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323568.840588:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323568.840590:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323568.840596:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.840604:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323568.840606:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323568.840610:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:3.0:1767323568.840785:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323568.840789:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323568.840812:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323568.840815:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323568.840816:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323568.840822:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323568.840829:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323568.840831:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323568.840833:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323568.840835:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323568.840837:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323568.840841:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975840384:192.168.204.130@tcp:400:kworker.0 02000000:00000001:0.0:1767323568.841022:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323568.841025:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323568.841030:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975840128:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323568.841035:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323568.841042:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323568.841045:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323568.841048:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323568.841053:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410065e1a00. 02000000:00000001:0.0:1767323568.841061:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323568.841067:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107164d0. 00000400:00000010:0.0:1767323568.841075:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089976e8. 00000100:00000200:0.0:1767323568.841082:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975840128, portal 25 00000100:00000001:0.0:1767323568.841085:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323568.841086:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456599680 : -118678252951936 : ffff941010e3e680) 00000100:00000040:0.0:1767323568.841093:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.841100:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323568.841103:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323568.841106:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089977f8. 00000100:00000200:0.0:1767323568.841109:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975840128, offset 0 00000400:00000200:0.0:1767323568.841115:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323568.841129:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323568.841136:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323568.841140:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323568.841143:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323568.841146:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323568.841150:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1483:1483:256:4294967295] 192.168.204.130@tcp LPNI seq info [1483:1483:8:4294967295] 00000400:00000200:0.0:1767323568.841161:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323568.841167:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323568.841172:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab300. 00000800:00000200:0.0:1767323568.841179:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323568.841187:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323568.841191:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab300 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323568.841206:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.841210:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300786926 00000100:00000010:0.0:1767323568.841214:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba25a0. 00000100:00000001:0.0:1767323568.841221:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:0.0:1767323568.841228:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300786926 00000100:00000010:0.0:1767323568.841231:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba29c0. 00000100:00000001:0.0:1767323568.841239:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:0.0:1767323568.841243:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300786926 00000100:00000010:0.0:1767323568.841246:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2060. 00000100:00000001:0.0:1767323568.841248:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1767323568.841251:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300786926 00000100:00000010:0.0:1767323568.841253:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2a80. 00000100:00000001:0.0:1767323568.841256:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1767323568.841259:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323568.841261:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.841265:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.841267:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323568.841275:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323568.841277:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323568.841279:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323568.841280:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323568.841282:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.841284:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323568.841582:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323568.841586:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323568.841588:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323568.841590:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323568.841593:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941003db7200. 02000000:00000001:3.0:1767323568.841595:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323568.841599:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328cb8. 00000400:00000010:3.0:1767323568.841603:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec770. 00000100:00000200:3.0:1767323568.841607:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975840384, portal 10 00000100:00000001:3.0:1767323568.841609:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323568.841610:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456589824 : -118678252961792 : ffff941010e3c000) 00000100:00000001:1.0:1767323568.841876:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.841886:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323568.841895:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323568.841899:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.841903:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003460c418] to pc [ptlrpcd_00_00+0] req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.841921:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.841924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323568.841928:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323568.841933:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3f480. 00000020:00000040:1.0:1767323568.841936:0:8:0:(genops.c:1229:class_import_get()) import ffff94100781b000 refcount=3 obd=lustre-OST0001-osc-ffff9410201aa800 00000100:00000001:1.0:1767323568.841939:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323568.841941:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323568.841944:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323568.841948:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c900. 00000100:00000001:1.0:1767323568.841952:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.841956:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323568.841963:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323568.841965:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.841969:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a96c566] to pc [ptlrpcd_00_01+1] req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.841978:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.841982:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6123) 00000100:00000001:1.0:1767323568.841992:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323568.841994:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323568.841995:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323568.841999:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.842018:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323568.842019:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323568.842022:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323568.842024:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323568.842026:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323568.842030:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975840512:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323568.842033:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323568.842036:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323568.842037:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323568.842039:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323568.842042:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102030f400. 02000000:00000001:1.0:1767323568.842044:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323568.842048:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156ec8. 00000400:00000010:1.0:1767323568.842051:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890acc0. 00000100:00000200:1.0:1767323568.842055:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975840512, portal 4 00000100:00000001:1.0:1767323568.842056:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323568.842058:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456595200 : -118678252956416 : ffff941010e3d500) 00000100:00000040:1.0:1767323568.842063:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.842069:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323568.842071:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323568.842073:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890ac38. 00000100:00000200:1.0:1767323568.842075:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1853171975840512, offset 0 00000400:00000200:1.0:1767323568.842080:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323568.842087:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323568.842090:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323568.842093:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323568.842096:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323568.842098:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323568.842101:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1484:1484:255:4294967295] 192.168.204.130@tcp LPNI seq info [1484:1484:7:4294967295] 00000400:00000200:1.0:1767323568.842110:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323568.842121:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323568.842124:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c800. 00000800:00000200:1.0:1767323568.842129:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323568.842134:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323568.842137:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c800 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323568.842141:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.842144:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: using a timeout of 13427 usecs (14 jiffies) 00000100:00000001:1.0:1767323568.842147:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300785680 00000100:00000001:1.0:1767323568.842150:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300786926 00000100:00000001:1.0:1767323568.842152:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300785680 00000100:00000001:1.0:1767323568.842154:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300786926 00000100:00000001:1.0:1767323568.842156:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300785680 00000100:00000001:1.0:1767323568.842158:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300786926 00000100:00000001:1.0:1767323568.842160:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300785680 00000100:00000001:1.0:1767323568.842162:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300786926 00000100:00000001:1.0:1767323568.842164:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323568.842166:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323568.842168:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323568.842171:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.842175:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323568.842176:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323568.842178:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323568.842180:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323568.842181:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323568.842183:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000001:1.0:1767323568.842185:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.842187:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323568.842188:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.842190:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323568.842191:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323568.842196:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323568.842200:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.842207:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323568.842209:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323568.842211:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323568.842213:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323568.842215:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323568.842218:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975840640:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323568.842221:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323568.842223:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323568.842225:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323568.842226:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323568.842229:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102030f800. 02000000:00000001:1.0:1767323568.842231:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323568.842234:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156d68. 00000400:00000010:1.0:1767323568.842238:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a770. 00000100:00000200:1.0:1767323568.842241:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975840640, portal 4 00000100:00000001:1.0:1767323568.842243:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323568.842244:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456603264 : -118678252948352 : ffff941010e3f480) 00000100:00000040:1.0:1767323568.842249:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.842256:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323568.842259:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323568.842261:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a550. 00000100:00000200:1.0:1767323568.842263:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1853171975840640, offset 0 00000400:00000200:1.0:1767323568.842267:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323568.842272:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323568.842274:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323568.842277:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323568.842279:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323568.842282:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323568.842284:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1485:1485:254:4294967295] 192.168.204.130@tcp LPNI seq info [1485:1485:6:4294967295] 00000400:00000200:1.0:1767323568.842296:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323568.842301:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323568.842304:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c600. 00000800:00000200:1.0:1767323568.842308:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323568.842312:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323568.842315:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323568.842318:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.842321:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: using a timeout of 12206 usecs (13 jiffies) 00000100:00000001:1.0:1767323568.842323:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300785679 00000100:00000001:1.0:1767323568.842326:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300786926 00000100:00000001:1.0:1767323568.842328:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300785679 00000100:00000040:3.0:1767323568.842574:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323568.842582:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323568.842584:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323568.842588:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec220. 00000100:00000200:3.0:1767323568.842591:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975840384, offset 0 00000400:00000200:3.0:1767323568.842596:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323568.842600:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323568.842603:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323568.842606:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323568.842608:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323568.842610:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323568.842613:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1486:1486:253:4294967295] 192.168.204.130@tcp LPNI seq info [1486:1486:5:4294967295] 00000400:00000200:3.0:1767323568.842621:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323568.842624:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323568.842628:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3200. 00000800:00000200:3.0:1767323568.842631:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323568.842636:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323568.842639:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3200 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323568.842641:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323568.842650:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 9627 usecs (10 jiffies) 00000100:00000001:3.0:1767323568.842653:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300785677 00000100:00000001:3.0:1767323568.842655:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300786926 00000100:00000001:3.0:1767323568.842657:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300785677 00000100:00000001:3.0:1767323568.842659:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300786926 00000100:00000001:3.0:1767323568.842661:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300785677 00000100:00000001:3.0:1767323568.842663:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300786926 00000100:00000001:3.0:1767323568.842665:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300785677 00000100:00000001:3.0:1767323568.842667:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300786926 00000100:00000001:3.0:1767323568.842669:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323568.842672:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323568.842674:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323568.842676:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323568.842680:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323568.842682:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323568.842684:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323568.843458:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323568.843479:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323568.843481:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323568.843489:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323568.843499:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323568.843501:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323568.843503:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323568.843506:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323568.843508:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323568.843512:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975840256:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323568.843515:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323568.843519:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323568.843522:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323568.843524:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323568.843528:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010c02000. 02000000:00000001:2.0:1767323568.843529:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323568.843534:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323568.843549:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc33b8. 00000100:00000200:2.0:1767323568.843553:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975840256, portal 10 00000100:00000001:2.0:1767323568.843555:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323568.843557:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456596992 : -118678252954624 : ffff941010e3dc00) 00000100:00000040:2.0:1767323568.843564:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323568.843571:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323568.843573:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323568.843575:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3330. 00000100:00000200:2.0:1767323568.843578:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975840256, offset 0 00000400:00000200:2.0:1767323568.843583:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323568.843590:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323568.843594:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323568.843596:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323568.843599:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323568.843602:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323568.843610:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1487:1487:252:4294967295] 192.168.204.130@tcp LPNI seq info [1487:1487:4:4294967295] 00000400:00000200:2.0:1767323568.843619:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323568.843624:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323568.843627:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7900. 00000800:00000200:2.0:1767323568.843631:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323568.843636:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323568.843639:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7900 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323568.843643:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323568.843646:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12160 usecs (13 jiffies) 00000100:00000001:2.0:1767323568.843648:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300785681 00000100:00000001:2.0:1767323568.843651:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300786926 00000100:00000001:2.0:1767323568.843653:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300785681 00000100:00000001:2.0:1767323568.843655:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300786926 00000100:00000001:2.0:1767323568.843657:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300785681 00000100:00000001:2.0:1767323568.843659:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300786926 00000100:00000001:2.0:1767323568.843661:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300785681 00000100:00000001:2.0:1767323568.843664:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300786926 00000100:00000001:2.0:1767323568.843666:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323568.843669:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.843672:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.843674:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.843678:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323568.843680:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323568.843682:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323568.843683:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323568.843684:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.843698:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.843732:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323568.843734:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323568.843741:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.843744:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323568.843958:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323568.843960:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323568.843963:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323568.844140:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323568.844146:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab300. 00000400:00000200:0.0:1767323568.844152:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323568.844157:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323568.844163:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089977f8 00000400:00000010:0.0:1767323568.844166:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089977f8. 00000100:00000001:0.0:1767323568.844169:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323568.844174:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.844182:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323568.844186:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.844191:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.844193:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323568.844214:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323568.844217:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c800. 00000400:00000200:0.0:1767323568.844225:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323568.844229:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323568.844232:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890ac38 00000400:00000010:0.0:1767323568.844233:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890ac38. 00000100:00000001:0.0:1767323568.844236:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323568.844240:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.844246:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323568.844249:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.844255:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.844256:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323568.844265:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323568.844268:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c600. 00000400:00000200:0.0:1767323568.844270:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323568.844273:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323568.844276:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a550 00000400:00000010:0.0:1767323568.844277:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a550. 00000100:00000001:0.0:1767323568.844280:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323568.844283:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.844289:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323568.844293:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.844298:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.844299:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323568.844308:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323568.844311:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3200. 00000400:00000200:0.0:1767323568.844315:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323568.844318:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323568.844320:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec220 00000400:00000010:0.0:1767323568.844322:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec220. 00000100:00000001:0.0:1767323568.844324:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323568.845575:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.845588:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323568.845591:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.845598:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.845600:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:1.0:1767323568.845641:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300786926 00000100:00000001:1.0:1767323568.845645:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300785682 00000100:00000001:1.0:1767323568.845648:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300786926 00000100:00000001:1.0:1767323568.845650:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300785682 00000100:00000001:1.0:1767323568.845652:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300786926 00000100:00000001:1.0:1767323568.845654:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323568.845657:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323568.845661:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323568.845664:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323568.847165:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323568.847173:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7900. 00000400:00000200:0.0:1767323568.847179:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323568.847186:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323568.847193:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3330 00000400:00000010:0.0:1767323568.847196:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3330. 00000100:00000001:0.0:1767323568.847200:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323568.847207:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.847217:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323568.847221:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.847228:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.847230:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1767323568.848824:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.848840:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323568.848844:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.848846:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.848864:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323568.849308:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 4 MB=0x695733953e300 00000400:00000200:3.0:1767323568.849317:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3065 [1] + 224 00000800:00000001:3.0:1767323568.849325:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.849331:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.849334:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323568.849338:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323568.849344:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323568.849367:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323568.849378:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323568.850201:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323568.850215:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.850223:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323568.850225:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.850227:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.850235:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323568.850246:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 4 MB=0x695733953e380 00000400:00000200:3.0:1767323568.850251:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.130@tcp of length 224/224 into md 0x306d [1] + 224 00000800:00000001:3.0:1767323568.850255:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.850259:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.850261:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323568.850263:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323568.850266:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323568.850271:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323568.850279:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323568.850286:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323568.850289:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.850292:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323568.850293:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.850295:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.850305:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323568.850310:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953e280 00000400:00000200:3.0:1767323568.850315:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3061 [1] + 224 00000800:00000001:3.0:1767323568.850318:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.850333:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.850336:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323568.850339:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323568.850342:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323568.850347:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323568.850355:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323568.850380:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323568.850405:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.850409:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.850579:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323568.850584:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323568.850591:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323568.850593:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323568.850597:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328cb8. 00000400:00000200:2.0:1767323568.850603:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec770 00000400:00000010:2.0:1767323568.850606:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec770. 00000100:00000001:2.0:1767323568.850609:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323568.850613:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323568.850622:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323568.850628:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323568.850631:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.850633:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323568.850636:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323568.850638:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323568.850640:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323568.850644:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323568.850652:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=20 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323568.850657:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=20 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323568.850660:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323568.850662:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323568.850665:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323568.850671:0:111004:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323568.850679:0:111004:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.850683:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323568.850696:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323568.850698:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323568.850699:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323568.850704:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323568.850723:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323568.850726:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323568.850728:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323568.850733:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323568.850741:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975840384:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323568.850746:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.850749:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323568.850752:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3c000 x1853171975840384/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323568.850759:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323568.850761:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323568.850765:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941003db7200. 02000000:00000001:2.0:1767323568.850770:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323568.850773:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323568.850775:0:111004:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323568.850776:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323568.850779:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c000. 02000000:00000001:2.0:1767323568.850783:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323568.850785:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323568.850787:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3c000. 00000100:00000001:2.0:1767323568.850790:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323568.850792:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.850794:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.850801:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323568.850803:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.850805:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323568.850807:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323568.851188:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323568.851193:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323568.851197:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323568.851200:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323568.851202:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156d68. 00000400:00000200:1.0:1767323568.851207:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a770 00000400:00000010:1.0:1767323568.851210:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a770. 00000100:00000001:1.0:1767323568.851214:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323568.851220:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323568.851242:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.851249:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323568.851252:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.851254:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323568.851256:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323568.851258:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323568.851260:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323568.851262:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323568.851269:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff94100781b458 time=20 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323568.851271:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff94100781b410 time=20 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323568.851273:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323568.851275:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323568.851276:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323568.851279:0:111001:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323568.851281:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323568.851282:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323568.851284:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323568.851285:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.851288:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.851295:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323568.851297:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323568.851298:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323568.851302:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323568.851309:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975840640:192.168.204.130@tcp:400:kworker.0 00000400:00000001:1.0:1767323568.851314:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323568.851316:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323568.851318:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156ec8. 00000400:00000200:1.0:1767323568.851320:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890acc0 00000400:00000010:1.0:1767323568.851327:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890acc0. 00000100:00000001:1.0:1767323568.851330:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323568.851333:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323568.851342:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.851348:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323568.851349:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.851351:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323568.851353:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323568.851354:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323568.851356:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323568.851358:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323568.851362:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941007818458 time=20 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323568.851365:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941007818410 time=20 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323568.851367:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323568.851369:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323568.851370:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323568.851372:0:111001:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323568.851374:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323568.851375:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323568.851377:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323568.851379:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323568.851598:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.851606:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323568.851608:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323568.851609:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323568.851613:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323568.851619:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975840512:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323568.851624:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.851631:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323568.851635:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3f480 x1853171975840640/t0(0) o400->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.851641:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323568.851643:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323568.851645:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102030f800. 02000000:00000001:1.0:1767323568.851648:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323568.851650:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323568.851652:0:111001:0:(genops.c:1242:class_import_put()) import ffff94100781b000 refcount=2 obd=lustre-OST0001-osc-ffff9410201aa800 00000020:00000001:1.0:1767323568.851654:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323568.851655:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c900. 02000000:00000001:1.0:1767323568.851658:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323568.851659:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323568.851661:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3f480. 00000100:00000001:1.0:1767323568.851664:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323568.851665:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.851667:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323568.851671:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3d500 x1853171975840512/t0(0) o400->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323568.851676:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323568.851677:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323568.851679:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102030f400. 02000000:00000001:1.0:1767323568.851681:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323568.851682:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323568.852559:0:111001:0:(genops.c:1242:class_import_put()) import ffff941007818000 refcount=2 obd=lustre-OST0000-osc-ffff9410201aa800 00000020:00000001:1.0:1767323568.852565:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323568.852568:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c700. 02000000:00000001:1.0:1767323568.852571:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323568.852572:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323568.852574:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d500. 00000100:00000001:1.0:1767323568.852577:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323568.852578:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.852580:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323568.852588:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323568.852590:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323568.852592:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323568.852602:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:3.0:1767323568.853153:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.853166:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323568.853168:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.853171:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.853180:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323568.853196:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953e200 00000400:00000200:3.0:1767323568.853204:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3079 [1] + 224 00000800:00000001:3.0:1767323568.853211:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.853216:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.853218:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323568.853222:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323568.853228:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323568.853234:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323568.853243:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323568.853265:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323568.853271:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.853279:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323568.853281:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.853290:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.853295:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323568.853302:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953e180 00000400:00000200:3.0:1767323568.853308:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3059 [1] + 224 00000800:00000001:3.0:1767323568.853311:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.853365:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323568.853369:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323568.853372:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323568.853376:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323568.853381:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323568.853418:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323568.853431:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323568.853436:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323568.853439:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323568.853619:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323568.853623:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1767323568.853629:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323568.853631:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323568.853634:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107164d0. 00000400:00000200:0.0:1767323568.853638:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089976e8 00000400:00000010:0.0:1767323568.853640:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089976e8. 00000100:00000001:0.0:1767323568.853643:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323568.853647:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323568.853655:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.853672:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323568.853674:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323568.853677:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323568.853679:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323568.853681:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323568.853683:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323568.853697:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323568.853703:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=21 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323568.853706:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=21 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323568.853708:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323568.853710:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323568.853712:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323568.853715:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.853717:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323568.853722:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.853728:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323568.853730:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323568.853732:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323568.853735:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323568.853743:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975840128:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323568.853748:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323568.853750:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323568.853753:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3e680 x1853171975840128/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323568.853758:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323568.853760:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323568.853762:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410065e1a00. 02000000:00000001:0.0:1767323568.853767:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323568.853769:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323568.853777:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:0.0:1767323568.853779:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323568.853780:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c100. 02000000:00000001:0.0:1767323568.853783:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323568.853785:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323568.853786:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3e680. 00000100:00000001:0.0:1767323568.853789:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323568.853791:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323568.853793:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323568.853799:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323568.853800:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323568.853802:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323568.853804:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.854072:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323568.854075:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323568.854079:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323568.854080:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323568.854088:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323568.854090:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc33b8 00000400:00000010:2.0:1767323568.854091:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc33b8. 00000100:00000001:2.0:1767323568.854093:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323568.854097:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323568.854103:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323568.854107:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323568.854108:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.854109:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323568.854110:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323568.854110:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323568.854111:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323568.854112:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323568.854117:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=20 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323568.854119:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=20 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323568.854120:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323568.854121:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323568.854123:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323568.854125:0:111003:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.854127:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323568.854129:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323568.854130:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323568.854131:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323568.854133:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323568.854137:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323568.854138:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323568.854139:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323568.854141:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323568.854145:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975840256:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323568.854151:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.854152:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323568.854154:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3dc00 x1853171975840256/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323584 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323568.854158:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323568.854159:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323568.854160:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010c02000. 02000000:00000001:2.0:1767323568.854162:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323568.854163:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323568.854164:0:111003:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323568.854165:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323568.854166:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cb00. 02000000:00000001:2.0:1767323568.854168:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323568.854169:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323568.854170:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3dc00. 00000100:00000001:2.0:1767323568.854171:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323568.854172:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.854174:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323568.854178:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323568.854179:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323568.854180:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323568.854181:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323569.415477:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323569.415484:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323569.415489:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323569.415491:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323569.415597:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323569.415601:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323569.415604:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323570.119505:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300786926, at 4300786944 00000100:00000040:1.0:1767323570.119505:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300786926, at 4300786944 00000100:00000010:2.0:1767323570.119534:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2060. 00000100:00000010:1.0:1767323570.119544:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba29c0. 00000100:00000040:0.0:1767323570.119659:0:127095:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300786926, at 4300786944 00000100:00000010:0.0:1767323570.119666:0:127095:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba25a0. 00000100:00000040:3.0:1767323570.121473:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300786926, at 4300786946 00000100:00000010:3.0:1767323570.121492:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2a80. 00010000:00000001:0.0:1767323570.439675:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323570.439684:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323570.439692:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323570.439696:0:127095:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323570.439698:0:127095:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323570.439704:0:127095:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323570.439707:0:127095:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323570.439709:0:127095:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323570.439713:0:127095:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323570.439716:0:127095:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323570.439719:0:127095:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323570.439721:0:127095:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323570.439755:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323570.439758:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323570.439761:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323571.463598:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323571.463605:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323571.463609:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323571.463610:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323571.463876:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323571.463880:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323571.463883:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323572.487581:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323572.487589:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323572.487594:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323572.487595:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323572.487618:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323572.487621:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323572.487624:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323573.511478:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323573.511484:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323573.511490:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323573.511491:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323573.511555:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323573.511557:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323573.511559:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323573.959523:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323573.959533:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323573.959553:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d500. 00000020:00000040:1.0:1767323573.959559:0:8:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:1.0:1767323573.959563:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323573.959566:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323573.959572:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323573.959582:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c700. 00000100:00000001:1.0:1767323573.959589:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959600:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323573.959611:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323573.959616:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959622:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003460c418] to pc [ptlrpcd_00_02+2] req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.959666:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959669:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323573.959673:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323573.959677:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3f480. 00000020:00000040:1.0:1767323573.959679:0:8:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323573.959682:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323573.959683:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323573.959685:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323573.959688:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c900. 00000100:00000001:1.0:1767323573.959690:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959695:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323573.959701:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323573.959717:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959721:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a96c566] to pc [ptlrpcd_00_03+3] req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.959730:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323573.959735:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323573.959738:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3ca80. 00000020:00000040:1.0:1767323573.959740:0:8:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323573.959742:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323573.959744:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323573.959746:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323573.959749:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cf00. 00000100:00000001:1.0:1767323573.959752:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959755:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323573.959762:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323573.959763:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959766:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008e400271] to pc [ptlrpcd_00_00+0] req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.959797:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.959800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323573.959802:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000001:1.0:1767323573.959805:0:8:0:(import.c:2045:ptlrpc_disconnect_and_idle_import()) Process entered 00000100:00000001:1.0:1767323573.959808:0:8:0:(import.c:1742:ptlrpc_disconnect_prep_req()) Process entered 00000100:00000010:1.0:1767323573.959811:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3c700. 00000020:00000040:1.0:1767323573.959813:0:8:0:(genops.c:1229:class_import_get()) import ffff941007818000 refcount=3 obd=lustre-OST0000-osc-ffff9410201aa800 00000100:00000001:1.0:1767323573.959815:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323573.959816:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323573.959818:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323573.959823:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cb00. 00000100:00000001:1.0:1767323573.959825:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323573.959833:0:8:0:(import.c:1780:ptlrpc_disconnect_prep_req()) Process leaving (rc=18446625395456591616 : -118678252960000 : ffff941010e3c700) 00000100:00080000:1.0:1767323573.959836:0:8:0:(import.c:65:import_set_state_nolock()) ffff941007818000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:02000000:1.0:1767323573.959839:0:8:0:(import.c:2080:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff9410201aa800: disconnect after 23s idle 00000100:00000001:2.0:1767323573.960118:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323573.960122:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323573.960128:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323573.960132:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.960138:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323573.960139:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323573.960142:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323573.960144:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323573.960145:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323573.960147:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975840768:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323573.960151:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323573.960154:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323573.960156:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323573.960158:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323573.960161:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102033a000. 02000000:00000001:2.0:1767323573.960162:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323573.960166:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323573.960171:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc33b8. 00000100:00000200:2.0:1767323573.960177:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975840768, portal 25 00000100:00000001:2.0:1767323573.960179:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323573.960180:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456595200 : -118678252956416 : ffff941010e3d500) 00000100:00000040:2.0:1767323573.960183:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.960188:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323573.960190:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323573.960191:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3110. 00000100:00000200:2.0:1767323573.960193:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975840768, offset 0 00000400:00000200:2.0:1767323573.960198:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323573.960209:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323573.960213:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323573.960217:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323573.960220:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323573.960221:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323573.960224:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1488:1488:256:4294967295] 192.168.204.130@tcp LPNI seq info [1488:1488:8:4294967295] 00000400:00000200:2.0:1767323573.960237:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323573.960241:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323573.960244:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7100. 00000800:00000200:2.0:1767323573.960258:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323573.960274:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000100:00000001:0.0:1767323573.960521:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323573.960524:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323573.960526:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323573.960532:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323573.960540:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323573.960542:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323573.960544:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323573.960546:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323573.960548:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323573.960551:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975841024:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323573.960554:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323573.960557:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323573.960558:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323573.960560:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323573.960564:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010e18000. 02000000:00000001:0.0:1767323573.960566:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323573.960570:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107164d0. 00000400:00000010:0.0:1767323573.960574:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089976e8. 00000100:00000200:0.0:1767323573.960577:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975841024, portal 10 00000100:00000001:0.0:1767323573.960579:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323573.960581:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456592512 : -118678252959104 : ffff941010e3ca80) 00000100:00000040:0.0:1767323573.960587:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323573.960606:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323573.960609:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323573.960612:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089977f8. 00000100:00000200:0.0:1767323573.960614:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975841024, offset 0 00000400:00000200:0.0:1767323573.960619:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323573.960624:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323573.960627:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323573.960630:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323573.960633:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323573.960635:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323573.960638:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1489:1489:255:4294967295] 192.168.204.130@tcp LPNI seq info [1489:1489:7:4294967295] 00000400:00000200:0.0:1767323573.960645:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323573.960650:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323573.960665:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab300. 00000800:00000200:0.0:1767323573.960669:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323573.960680:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323573.960683:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab300 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323573.960694:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323573.960698:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 10097 usecs (11 jiffies) 00000100:00000001:0.0:1767323573.960701:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300790796 00000100:00000010:0.0:1767323573.960705:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba25a0. 00000800:00000200:2.0:1767323573.960709:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7100 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323573.960711:0:111001:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:2.0:1767323573.960713:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323573.960716:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300792046 00000100:00000001:0.0:1767323573.960718:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300790796 00000100:00000001:2.0:1767323573.960721:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300790796 00000100:00000010:0.0:1767323573.960721:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2600. 00000100:00000001:2.0:1767323573.960724:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300792046 00000100:00000001:0.0:1767323573.960724:0:111001:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:0.0:1767323573.960727:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300790796 00000100:00000001:2.0:1767323573.960728:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300790796 00000100:00000010:0.0:1767323573.960730:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba24e0. 00000100:00000001:2.0:1767323573.960731:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300792046 00000100:00000001:0.0:1767323573.960733:0:111001:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:2.0:1767323573.960753:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323573.960757:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.960776:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323573.960779:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323573.960780:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323573.960786:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.960792:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323573.960793:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323573.960795:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323573.960797:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323573.960799:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323573.960801:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975840896:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323573.960805:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000800:00000200:2.0:1767323573.960805:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 02000000:00000001:3.0:1767323573.960807:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000800:00000010:2.0:1767323573.960809:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab300. 02000000:00000001:3.0:1767323573.960814:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323573.960815:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000400:00000200:2.0:1767323573.960816:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 02000000:00000010:3.0:1767323573.960818:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941004ced000. 02000000:00000001:3.0:1767323573.960820:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1767323573.960821:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000010:3.0:1767323573.960823:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328bb0. 00000400:00000200:2.0:1767323573.960825:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089977f8 00000400:00000010:2.0:1767323573.960828:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089977f8. 00000100:00000001:2.0:1767323573.960832:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323573.960837:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.960846:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323573.960850:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323573.960851:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300790796 00000100:00000010:0.0:1767323573.960855:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2480. 00000100:00000001:2.0:1767323573.960857:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323573.960859:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:0.0:1767323573.960859:0:111001:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:0.0:1767323573.960861:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323573.960864:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323573.960867:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323573.960869:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323573.960876:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323573.960877:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323573.960879:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323573.960880:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323573.960882:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323573.960892:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1767323573.960927:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323573.960929:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7100. 00000400:00000200:2.0:1767323573.960937:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323573.960941:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000010:3.0:1767323573.965060:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aeca18. 00000100:00000200:3.0:1767323573.965076:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975840896, portal 10 00000100:00000001:3.0:1767323573.965080:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323573.965082:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456603264 : -118678252948352 : ffff941010e3f480) 00000100:00000040:3.0:1767323573.965098:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.965107:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323573.965110:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323573.965113:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aeccc0. 00000100:00000200:3.0:1767323573.965117:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975840896, offset 0 00000400:00000200:3.0:1767323573.965123:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323573.965137:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323573.965142:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323573.965146:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323573.965149:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323573.965152:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323573.965156:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1490:1490:255:4294967295] 192.168.204.130@tcp LPNI seq info [1490:1490:7:4294967295] 00000400:00000200:3.0:1767323573.965167:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323573.965173:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323573.965179:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3600. 00000800:00000200:3.0:1767323573.965187:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323573.965194:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323573.965198:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323573.965203:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323573.965207:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12592 usecs (13 jiffies) 00000100:00000001:3.0:1767323573.965211:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300790798 00000100:00000001:3.0:1767323573.965239:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.965241:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300790798 00000100:00000001:3.0:1767323573.965243:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.965246:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300790798 00000100:00000001:3.0:1767323573.965254:0:111004:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, simply extend its deadline from 4300790796 00000100:00000001:3.0:1767323573.965261:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300790798 00000100:00000001:3.0:1767323573.965264:0:111004:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, simply extend its deadline from 4300790796 00000100:00000001:3.0:1767323573.965267:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323573.965270:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.965275:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.965278:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323573.965286:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323573.965288:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323573.965291:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323573.965293:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323573.965294:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.965297:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.965333:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300790798 00000100:00000001:3.0:1767323573.965338:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300792046 00000100:00000001:3.0:1767323573.965340:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300790798 00000100:00000001:3.0:1767323573.965343:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323573.965345:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.965347:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.965349:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323573.965352:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323573.965353:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323573.965355:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323573.965356:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323573.965357:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.965359:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1767323573.966229:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3110 00000400:00000010:2.0:1767323573.966235:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3110. 00000100:00000001:2.0:1767323573.966507:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323573.966516:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.966527:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323573.966531:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.966619:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323573.966620:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1767323573.966691:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323573.966695:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3600. 00000400:00000200:2.0:1767323573.966701:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323573.966706:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323573.966709:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aeccc0 00000400:00000010:2.0:1767323573.966711:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aeccc0. 00000100:00000001:2.0:1767323573.966713:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323573.966717:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.966725:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323573.966728:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.966734:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323573.966735:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1767323573.970834:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.970864:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323573.970869:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.970872:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323573.970883:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323573.970900:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953e400 00000400:00000200:3.0:1767323573.970911:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3081 [1] + 224 00000800:00000001:3.0:1767323573.970919:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.970924:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323573.970927:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323573.970931:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323573.970938:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323573.970947:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323573.970966:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.970989:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323573.970998:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.971002:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323573.971004:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.971005:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323573.971009:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323573.971016:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953e500 00000400:00000200:3.0:1767323573.971023:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3089 [1] + 224 00000800:00000001:3.0:1767323573.971028:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.971084:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323573.971087:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323573.971090:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323573.971093:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323573.971098:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323573.971106:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323573.971174:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323573.971179:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323573.971199:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323573.971205:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.971209:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323573.971229:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323573.971232:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323573.971238:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323573.971240:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323573.971243:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323573.971248:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc33b8 00000400:00000010:2.0:1767323573.971250:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc33b8. 00000100:00000001:2.0:1767323573.971254:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323573.971263:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323573.971272:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.971374:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323573.971376:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323573.971378:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323573.971407:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323573.971410:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323573.971412:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323573.971415:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323573.971422:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=26 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323573.971426:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=26 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323573.971428:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323573.971430:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323573.971433:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323573.971435:0:111003:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323573.971438:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323573.971452:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.971458:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323573.971461:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323573.971463:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323573.971467:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323573.971474:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975840768:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323573.971478:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323573.971481:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323573.971483:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3d500 x1853171975840768/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.971489:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323573.971497:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323573.971501:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102033a000. 02000000:00000001:2.0:1767323573.971504:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323573.971506:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323573.971508:0:111003:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:2.0:1767323573.971510:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323573.971513:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c700. 02000000:00000001:2.0:1767323573.971516:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323573.971518:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323573.971520:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d500. 00000100:00000001:2.0:1767323573.971523:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323573.971524:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323573.971526:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323573.971544:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323573.971546:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323573.971548:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323573.971550:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323573.973762:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323573.973771:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.973783:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0993e43] to pc [ptlrpcd_rcv+-1] req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.973804:0:8:0:(import.c:2084:ptlrpc_disconnect_and_idle_import()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.973808:0:8:0:(pinger.c:123:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.973811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323573.973815:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000001:1.0:1767323573.973817:0:8:0:(import.c:2045:ptlrpc_disconnect_and_idle_import()) Process entered 00000100:00000001:1.0:1767323573.973820:0:8:0:(import.c:1742:ptlrpc_disconnect_prep_req()) Process entered 00000100:00000010:1.0:1767323573.973827:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3ce00. 00000020:00000040:1.0:1767323573.973832:0:8:0:(genops.c:1229:class_import_get()) import ffff94100781b000 refcount=3 obd=lustre-OST0001-osc-ffff9410201aa800 00000100:00000001:1.0:1767323573.973836:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323573.973838:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323573.973843:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323573.973850:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c100. 00000100:00000001:1.0:1767323573.973856:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323573.973859:0:8:0:(import.c:1780:ptlrpc_disconnect_prep_req()) Process leaving (rc=18446625395456593408 : -118678252958208 : ffff941010e3ce00) 00000100:00080000:1.0:1767323573.973863:0:8:0:(import.c:65:import_set_state_nolock()) ffff94100781b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:02000000:1.0:1767323573.973865:0:8:0:(import.c:2080:ptlrpc_disconnect_and_idle_import()) lustre-OST0001-osc-ffff9410201aa800: disconnect after 23s idle 00000100:00000001:1.0:1767323573.973867:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323573.973869:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.973873:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a6162199] to pc [ptlrpcd_rcv+-1] req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.973881:0:8:0:(import.c:2084:ptlrpc_disconnect_and_idle_import()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.973882:0:8:0:(pinger.c:123:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.973888:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6128) 00000100:00000001:3.0:1767323573.974262:0:111000:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000080:00000010:3.0:1767323573.974272:0:111000:0:(vvp_dev.c:69:ll_thread_key_init()) slab-alloced 'lti': 168 at ffff94101829de70. 00000080:00000010:3.0:1767323573.974277:0:111000:0:(vvp_dev.c:120:vvp_thread_key_init()) slab-alloced 'vti': 584 at ffff941039bcbb50. 00000080:00000010:3.0:1767323573.974284:0:111000:0:(vvp_dev.c:95:vvp_session_key_init()) slab-alloced 'session': 240 at ffff941011929e10. 00000100:00000001:3.0:1767323573.974287:0:111000:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323573.974289:0:111000:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323573.974295:0:111000:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.974302:0:111000:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323573.974304:0:111000:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323573.974307:0:111000:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323573.974310:0:111000:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323573.974313:0:111000:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323573.974316:0:111000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111000:1853171975841152:192.168.204.130@tcp:9:kworker.0 00000100:00000001:3.0:1767323573.974320:0:111000:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323573.974325:0:111000:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323573.974327:0:111000:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323573.974329:0:111000:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323573.974333:0:111000:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941004cecc00. 02000000:00000001:3.0:1767323573.974335:0:111000:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323573.974342:0:111000:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328cb8. 00000400:00000010:3.0:1767323573.974349:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec550. 00000100:00000200:3.0:1767323573.974356:0:111000:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975841152, portal 4 00000100:00000001:3.0:1767323573.974359:0:111000:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323573.974360:0:111000:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456591616 : -118678252960000 : ffff941010e3c700) 00000100:00000040:3.0:1767323573.974367:0:111000:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.974374:0:111000:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323573.974418:0:111000:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323573.974421:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec880. 00000100:00000200:3.0:1767323573.974425:0:111000:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1853171975841152, offset 0 00000400:00000200:3.0:1767323573.974431:0:111000:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323573.974452:0:111000:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323573.974457:0:111000:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323573.974461:0:111000:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323573.974465:0:111000:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323573.974468:0:111000:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323573.974471:0:111000:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1491:1491:256:4294967295] 192.168.204.130@tcp LPNI seq info [1491:1491:8:4294967295] 00000400:00000200:3.0:1767323573.974482:0:111000:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323573.974488:0:111000:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323573.974493:0:111000:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3f00. 00000800:00000200:3.0:1767323573.974499:0:111000:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323573.974507:0:111000:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323573.974511:0:111000:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3f00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323573.974524:0:111000:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323573.974528:0:111000:0:(niobuf.c:634:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: using a timeout of 13156 usecs (14 jiffies) 00000100:00000001:3.0:1767323573.974532:0:111000:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300790812 00000100:00000001:3.0:1767323573.974535:0:111000:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.974537:0:111000:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300790812 00000100:00000001:3.0:1767323573.974539:0:111000:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.974541:0:111000:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300790812 00000100:00000001:3.0:1767323573.974543:0:111000:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.974545:0:111000:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300790812 00000100:00000001:3.0:1767323573.974547:0:111000:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0000-osc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.974550:0:111000:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323573.974552:0:111000:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.974560:0:111000:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323573.974564:0:111000:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.974571:0:111000:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323573.974572:0:111000:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323573.974574:0:111000:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323573.974575:0:111000:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323573.974577:0:111000:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323573.974580:0:111000:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111000:1853171975841280:192.168.204.130@tcp:9:kworker.0 00000100:00000001:3.0:1767323573.974583:0:111000:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323573.974585:0:111000:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323573.974587:0:111000:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323573.974589:0:111000:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323573.974592:0:111000:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941004cedc00. 02000000:00000001:3.0:1767323573.974594:0:111000:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323573.974597:0:111000:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410013289a0. 00000400:00000010:3.0:1767323573.974601:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec440. 00000100:00000200:3.0:1767323573.974604:0:111000:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975841280, portal 4 00000100:00000001:3.0:1767323573.974606:0:111000:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323573.974607:0:111000:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456593408 : -118678252958208 : ffff941010e3ce00) 00000100:00000040:3.0:1767323573.974612:0:111000:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.974619:0:111000:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323573.974621:0:111000:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323573.974623:0:111000:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecb28. 00000100:00000200:3.0:1767323573.974625:0:111000:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 28, xid 1853171975841280, offset 0 00000400:00000200:3.0:1767323573.974630:0:111000:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323573.974634:0:111000:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323573.974637:0:111000:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323573.974639:0:111000:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323573.974642:0:111000:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323573.974644:0:111000:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323573.974647:0:111000:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1492:1492:255:4294967295] 192.168.204.130@tcp LPNI seq info [1492:1492:7:4294967295] 00000400:00000200:3.0:1767323573.974660:0:111000:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323573.974665:0:111000:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323573.974668:0:111000:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3400. 00000800:00000200:3.0:1767323573.974685:0:111000:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323573.974690:0:111000:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323573.974692:0:111000:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3400 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323573.974695:0:111000:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323573.974698:0:111000:0:(niobuf.c:634:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: using a timeout of 12105 usecs (13 jiffies) 00000100:00000001:3.0:1767323573.974700:0:111000:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300790811 00000100:00000001:3.0:1767323573.974702:0:111000:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.974704:0:111000:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300790811 00000100:00000001:3.0:1767323573.974706:0:111000:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.974708:0:111000:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300790811 00000100:00000001:3.0:1767323573.974710:0:111000:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.974712:0:111000:0:(niobuf.c:662:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300790811 00000100:00000001:3.0:1767323573.974714:0:111000:0:(niobuf.c:691:kick_cpu_latency()) lustre-OST0001-osc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300792046 00000100:00000001:3.0:1767323573.974716:0:111000:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323573.974718:0:111000:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.974721:0:111000:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.974723:0:111000:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323573.974728:0:111000:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323573.974730:0:111000:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=5 : 5 : 5) 00000100:00000001:3.0:1767323573.974732:0:111000:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323573.974733:0:111000:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323573.974735:0:111000:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.974736:0:111000:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:0.0:1767323573.978974:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323573.978982:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323573.978986:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107164d0. 00000400:00000200:0.0:1767323573.978994:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089976e8 00000400:00000010:0.0:1767323573.978997:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089976e8. 00000100:00000001:0.0:1767323573.979001:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323573.979014:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323573.979026:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323573.979034:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323573.979037:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323573.979040:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323573.979043:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323573.979045:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323573.979048:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323573.979051:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323573.979061:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=25 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323573.979065:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=25 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323573.979067:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323573.979085:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323573.979088:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1767323573.979094:0:111001:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1767323573.979102:0:111001:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323573.979105:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323573.979107:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323573.979109:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323573.979111:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323573.979115:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323573.979122:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323573.979126:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323573.979128:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323573.979132:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323573.979140:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975841024:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323573.979146:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323573.979150:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323573.979153:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3ca80 x1853171975841024/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323573.979161:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323573.979163:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323573.979167:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010e18000. 02000000:00000001:0.0:1767323573.979171:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323573.979174:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323573.979176:0:111001:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323573.979178:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323573.979181:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cf00. 02000000:00000001:0.0:1767323573.979185:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323573.979186:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323573.979194:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3ca80. 00000100:00000001:0.0:1767323573.979198:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323573.979199:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323573.979201:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323573.979209:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323573.979211:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323573.979213:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323573.979216:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:2.0:1767323573.979330:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323573.979343:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1767323573.979345:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323573.979348:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323573.979355:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323573.979371:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953e480 00000400:00000200:2.0:1767323573.979379:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3091 [1] + 224 00000800:00000001:2.0:1767323573.979405:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323573.979413:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323573.979416:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323573.979420:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:2.0:1767323573.979427:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323573.979432:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323573.979451:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.979468:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000200:2.0:1767323573.979509:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323573.979512:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3f00. 00000400:00000200:2.0:1767323573.979517:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323573.979520:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323573.979523:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec880 00000400:00000010:2.0:1767323573.979525:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec880. 00000100:00000001:2.0:1767323573.979528:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323573.979532:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.979540:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323573.979544:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.979550:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323573.979552:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:2.0:1767323573.979556:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323573.979559:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000200:2.0:1767323573.979603:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323573.979606:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3400. 00000400:00000200:2.0:1767323573.979609:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323573.979613:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323573.979615:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecb28 00000400:00000010:2.0:1767323573.979617:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecb28. 00000100:00000001:2.0:1767323573.979619:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323573.979623:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.979630:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323573.979633:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323573.979638:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323573.979639:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:3.0:1767323573.979895:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323573.979900:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323573.979904:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323573.979906:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323573.979915:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328bb0. 00000400:00000200:3.0:1767323573.979919:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aeca18 00000400:00000010:3.0:1767323573.979921:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aeca18. 00000100:00000001:3.0:1767323573.979924:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323573.979929:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323573.979938:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.979944:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323573.979946:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323573.979948:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323573.979949:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323573.979951:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323573.979952:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323573.979955:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323573.979961:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=25 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323573.979964:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=25 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323573.979966:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323573.979968:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323573.979970:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323573.979972:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.979975:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323573.979976:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323573.979978:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323573.979979:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323573.979983:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.979990:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323573.979993:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323573.979994:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323573.979998:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323573.980005:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975840896:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323573.980015:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323573.980017:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323573.980021:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3f480 x1853171975840896/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323589 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.980027:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323573.980029:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323573.980031:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941004ced000. 02000000:00000001:3.0:1767323573.980034:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323573.980036:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323573.980037:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323573.980039:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323573.980041:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c900. 02000000:00000001:3.0:1767323573.980044:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323573.980045:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323573.980047:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3f480. 00000100:00000001:3.0:1767323573.980050:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323573.980051:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323573.980053:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323573.980058:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323573.980059:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323573.980061:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323573.980064:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:3.0:1767323573.985991:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.986009:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323573.986013:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.986015:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323573.986027:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323573.986044:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 4 MB=0x695733953e580 00000400:00000200:3.0:1767323573.986053:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3099 [1] + 224 00000800:00000001:3.0:1767323573.986062:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.986066:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323573.986069:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323573.986074:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323573.986081:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323573.986103:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323573.986114:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.986137:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323573.986146:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.986150:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323573.986152:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.986154:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323573.986157:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323573.986163:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 4 MB=0x695733953e600 00000400:00000200:3.0:1767323573.986168:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 4 from 12345-192.168.204.130@tcp of length 224/224 into md 0x30a1 [1] + 224 00000800:00000001:3.0:1767323573.986171:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.986176:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323573.986178:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323573.986181:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323573.986184:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323573.986188:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323573.986197:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323573.986204:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323573.986207:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323573.986210:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.986481:0:111000:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323573.986492:0:111000:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323573.986499:0:111000:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323573.986501:0:111000:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323573.986503:0:111000:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328cb8. 00000400:00000200:1.0:1767323573.986508:0:111000:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec550 00000400:00000010:1.0:1767323573.986510:0:111000:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec550. 00000100:00000001:1.0:1767323573.986514:0:111000:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323573.986519:0:111000:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323573.986529:0:111000:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.986535:0:111000:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323573.986537:0:111000:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.986540:0:111000:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323573.986543:0:111000:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323573.986545:0:111000:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323573.986547:0:111000:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323573.986551:0:111000:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323573.986560:0:111000:0:(import.c:2128:obd_at_measure()) add 5 to ffff941007818458 time=25 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323573.986564:0:111000:0:(import.c:2128:obd_at_measure()) add 1 to ffff941007818410 time=25 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323573.986567:0:111000:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323573.986568:0:111000:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323573.986571:0:111000:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323573.986575:0:111000:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323573.986578:0:111000:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323573.986580:0:111000:0:(client.c:3077:ptlrpc_free_committed()) lustre-OST0000-osc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323573.986582:0:111000:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323573.986583:0:111000:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.986589:0:111000:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.986596:0:111000:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323573.986599:0:111000:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323573.986601:0:111000:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00080000:1.0:1767323573.986606:0:111000:0:(import.c:1990:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767323573.986624:0:111000:0:(import.c:65:import_set_state_nolock()) ffff941007818000 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00000040:1.0:1767323573.986630:0:111000:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323573.986637:0:111000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111000:1853171975841152:192.168.204.130@tcp:9:kworker.0 00000400:00000001:1.0:1767323573.986645:0:111000:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323573.986646:0:111000:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323573.986648:0:111000:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410013289a0. 00000400:00000200:1.0:1767323573.986650:0:111000:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec440 00000400:00000010:1.0:1767323573.986652:0:111000:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec440. 00000100:00000001:1.0:1767323573.986654:0:111000:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323573.986658:0:111000:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323573.986665:0:111000:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.986671:0:111000:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323573.986773:0:111000:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.986776:0:111000:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323573.986777:0:111000:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323573.986778:0:111000:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323573.986780:0:111000:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323573.986782:0:111000:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323573.986786:0:111000:0:(import.c:2128:obd_at_measure()) add 5 to ffff94100781b458 time=25 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323573.986789:0:111000:0:(import.c:2128:obd_at_measure()) add 1 to ffff94100781b410 time=25 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323573.986791:0:111000:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323573.986793:0:111000:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323573.986794:0:111000:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323573.986796:0:111000:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323573.986798:0:111000:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323573.986800:0:111000:0:(client.c:3077:ptlrpc_free_committed()) lustre-OST0001-osc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323573.986801:0:111000:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323573.986809:0:111000:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323573.986815:0:111000:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.986821:0:111000:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323573.986823:0:111000:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323573.986824:0:111000:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00080000:1.0:1767323573.986827:0:111000:0:(import.c:1990:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1767323573.986833:0:111000:0:(import.c:65:import_set_state_nolock()) ffff94100781b000 lustre-OST0001_UUID: changing import state from CONNECTING to IDLE 00000100:00000040:1.0:1767323573.986837:0:111000:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323573.986845:0:111000:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111000:1853171975841280:192.168.204.130@tcp:9:kworker.0 00000100:00000001:1.0:1767323573.986848:0:111000:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.986851:0:111000:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323573.986854:0:111000:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3c700 x1853171975841152/t0(0) o9->lustre-OST0000-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.986860:0:111000:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323573.986863:0:111000:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323573.986867:0:111000:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941004cecc00. 02000000:00000001:1.0:1767323573.986871:0:111000:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323573.986874:0:111000:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323573.986875:0:111000:0:(genops.c:1242:class_import_put()) import ffff941007818000 refcount=2 obd=lustre-OST0000-osc-ffff9410201aa800 00000020:00000001:1.0:1767323573.986878:0:111000:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323573.986880:0:111000:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cb00. 02000000:00000001:1.0:1767323573.986884:0:111000:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323573.986886:0:111000:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323573.986887:0:111000:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3c700. 00000100:00000001:1.0:1767323573.986890:0:111000:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323573.986892:0:111000:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.986893:0:111000:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323573.986896:0:111000:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3ce00 x1853171975841280/t0(0) o9->lustre-OST0001-osc-ffff9410201aa800@192.168.204.130@tcp:28/4 lens 224/224 e 0 to 0 dl 1767323583 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323573.986907:0:111000:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323573.986908:0:111000:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323573.986909:0:111000:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941004cedc00. 02000000:00000001:1.0:1767323573.986912:0:111000:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323573.986913:0:111000:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323573.986914:0:111000:0:(genops.c:1242:class_import_put()) import ffff94100781b000 refcount=2 obd=lustre-OST0001-osc-ffff9410201aa800 00000020:00000001:1.0:1767323573.986916:0:111000:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323573.986917:0:111000:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c100. 02000000:00000001:1.0:1767323573.986919:0:111000:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323573.986920:0:111000:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323573.986922:0:111000:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3ce00. 00000100:00000001:1.0:1767323573.986924:0:111000:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323573.986925:0:111000:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.986927:0:111000:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323573.986934:0:111000:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323573.986936:0:111000:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323573.986938:0:111000:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323573.986939:0:111000:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323574.537694:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323574.537703:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323574.537710:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323574.537711:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323574.537742:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323574.537745:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323574.537749:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323575.239498:0:127095:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300792046, at 4300792064 00000100:00000010:0.0:1767323575.239518:0:127095:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba25a0. 00000100:00000040:3.0:1767323575.239715:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300792046, at 4300792064 00000100:00000010:3.0:1767323575.239723:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2480. 00000100:00000040:1.0:1767323575.239998:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300792046, at 4300792064 00000100:00000010:1.0:1767323575.240013:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2600. 00000100:00000040:2.0:1767323575.244245:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300792046, at 4300792068 00000100:00000010:2.0:1767323575.244259:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba24e0. 00010000:00000001:0.0:1767323575.560462:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323575.560470:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323575.560477:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323575.560479:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323575.560589:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323575.560612:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323575.560616:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323576.583550:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323576.583560:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323576.583567:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323576.583568:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323576.583602:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323576.583605:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323576.583608:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323577.607508:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323577.607518:0:127095:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323577.607520:0:127095:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323577.607523:0:127095:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323577.607528:0:127095:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323577.607530:0:127095:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323577.607532:0:127095:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323577.607535:0:127095:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323577.607539:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323577.607557:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323577.607656:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323577.607660:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323577.607662:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323578.631460:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323578.631466:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323578.631472:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323578.631473:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323578.631493:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323578.631496:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323578.631499:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323579.079907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323579.079916:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323579.079923:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3ce00. 00000020:00000040:1.0:1767323579.079929:0:8:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:1.0:1767323579.079933:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323579.079935:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323579.079940:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323579.079947:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c100. 00000100:00000001:1.0:1767323579.079954:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.079965:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323579.079982:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323579.079986:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.080000:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a6162199] to pc [ptlrpcd_00_01+1] req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.080186:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.080190:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323579.080194:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323579.080197:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3c700. 00000020:00000040:1.0:1767323579.080200:0:8:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323579.080203:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323579.080204:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323579.080206:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323579.080210:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cb00. 00000100:00000001:1.0:1767323579.080214:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.080219:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323579.080227:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323579.080229:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.080233:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0993e43] to pc [ptlrpcd_00_02+2] req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.080257:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.080259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323579.080263:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323579.080266:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3c380. 00000020:00000040:1.0:1767323579.080268:0:8:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323579.080270:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323579.080271:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323579.080273:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323579.080276:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c000. 00000100:00000001:1.0:1767323579.080278:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.080282:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323579.080301:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323579.080303:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.080307:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000969e9325] to pc [ptlrpcd_00_03+3] req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.080316:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323579.080318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1767323579.080322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323579.080324:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1767323579.080327:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323579.080332:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6133) 00000100:00000001:0.0:1767323579.080411:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323579.080414:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323579.080417:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323579.080423:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323579.080431:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323579.080433:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323579.080437:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323579.080439:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323579.080442:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323579.080446:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975841408:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323579.080450:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323579.080455:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323579.080457:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323579.080459:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323579.080464:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941003e8b800. 02000000:00000001:0.0:1767323579.080467:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323579.080473:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107164d0. 00000400:00000010:0.0:1767323579.080481:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089976e8. 00000100:00000200:0.0:1767323579.080488:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975841408, portal 25 00000100:00000001:0.0:1767323579.080490:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323579.080492:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456593408 : -118678252958208 : ffff941010e3ce00) 00000100:00000040:0.0:1767323579.080498:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.080500:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323579.080504:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323579.080507:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000001:0.0:1767323579.080509:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323579.080517:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323579.080524:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323579.080537:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997ee0. 00000100:00000001:3.0:1767323579.080541:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000200:0.0:1767323579.080543:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975841408, offset 0 00000100:00000001:3.0:1767323579.080545:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323579.080550:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323579.080552:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000400:00000200:0.0:1767323579.080554:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 02000000:00000001:3.0:1767323579.080556:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323579.080562:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975841536:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323579.080567:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323579.080570:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323579.080573:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1767323579.080573:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 02000000:00000001:3.0:1767323579.080577:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323579.080582:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410105c3e00. 00000400:00000200:0.0:1767323579.080582:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000001:3.0:1767323579.080587:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1767323579.080591:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000010:3.0:1767323579.080592:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328bb0. 00000400:00000200:0.0:1767323579.080597:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000010:3.0:1767323579.080599:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aeca18. 00000400:00000200:0.0:1767323579.080603:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000200:3.0:1767323579.080606:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975841536, portal 10 00000100:00000001:3.0:1767323579.080611:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000400:00000200:0.0:1767323579.080611:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1493:1493:256:4294967295] 192.168.204.130@tcp LPNI seq info [1493:1493:8:4294967295] 00000100:00000001:3.0:1767323579.080614:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456591616 : -118678252960000 : ffff941010e3c700) 00000100:00000040:3.0:1767323579.080625:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323579.080632:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:3.0:1767323579.080645:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000800:00000200:0.0:1767323579.080647:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000100:00000040:3.0:1767323579.080652:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323579.080655:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012abb00. 00000400:00000010:3.0:1767323579.080657:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecf68. 00000100:00000200:3.0:1767323579.080662:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975841536, offset 0 00000800:00000200:0.0:1767323579.080667:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000400:00000200:3.0:1767323579.080669:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323579.080677:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000800:00000200:0.0:1767323579.080682:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000400:00000200:3.0:1767323579.080684:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:0.0:1767323579.080689:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012abb00 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:3.0:1767323579.080691:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323579.080695:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323579.080698:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323579.080701:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1494:1494:255:4294967295] 192.168.204.130@tcp LPNI seq info [1494:1494:7:4294967295] 00000100:00000001:0.0:1767323579.080709:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323579.080711:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:0.0:1767323579.080716:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300797166 00000100:00000010:0.0:1767323579.080723:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2180. 00000800:00000200:3.0:1767323579.080727:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000100:00000001:0.0:1767323579.080732:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000800:00000010:3.0:1767323579.080733:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3000. 00000800:00000200:3.0:1767323579.080741:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000100:00000001:0.0:1767323579.080741:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300797166 00000100:00000010:0.0:1767323579.080748:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba23c0. 00000800:00000200:3.0:1767323579.080751:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000100:00000001:0.0:1767323579.080753:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000800:00000200:3.0:1767323579.080756:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3000 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323579.080758:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300797166 00000100:00000001:3.0:1767323579.080763:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:0.0:1767323579.080763:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba25a0. 00000100:00000001:0.0:1767323579.080768:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000040:3.0:1767323579.080770:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 13567 usecs (14 jiffies) 00000100:00000001:0.0:1767323579.080772:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300797166 00000100:00000001:3.0:1767323579.080775:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300795919 00000100:00000010:0.0:1767323579.080776:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2780. 00000100:00000001:3.0:1767323579.080781:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300797166 00000100:00000001:0.0:1767323579.080782:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:3.0:1767323579.080788:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300795919 00000100:00000001:0.0:1767323579.080788:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323579.080792:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300797166 00000100:00000001:3.0:1767323579.080794:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300795919 00000100:00000001:3.0:1767323579.080799:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300797166 00000100:00000001:0.0:1767323579.080799:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.080805:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300795919 00000100:00000001:0.0:1767323579.080807:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.080808:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300797166 00000100:00000001:0.0:1767323579.080812:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.080813:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323579.080818:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.080821:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323579.080823:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323579.080824:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323579.080827:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323579.080830:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323579.080831:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323579.080834:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323579.080834:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323579.080838:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.080839:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323579.080842:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.080843:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323579.080846:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323579.080850:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:3.0:1767323579.080852:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.080854:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323579.080857:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.080859:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323579.080860:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323579.080873:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323579.080875:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000001:0.0:1767323579.080876:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323579.080883:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.080892:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323579.080894:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323579.080896:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323579.080898:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323579.080900:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323579.080903:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975841664:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323579.080907:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323579.080909:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323579.080911:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323579.080912:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323579.080915:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410105c3c00. 02000000:00000001:3.0:1767323579.080917:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323579.080920:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328b58. 00000400:00000010:3.0:1767323579.080924:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecee0. 00000100:00000200:3.0:1767323579.080927:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975841664, portal 10 00000100:00000001:3.0:1767323579.080929:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323579.080930:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456590720 : -118678252960896 : ffff941010e3c380) 00000100:00000040:3.0:1767323579.080936:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.080943:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323579.080946:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323579.080949:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec4c8. 00000100:00000200:3.0:1767323579.080952:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975841664, offset 0 00000400:00000200:3.0:1767323579.080956:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323579.080961:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323579.080964:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323579.080967:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323579.080970:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323579.080973:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000800:00000200:1.0:1767323579.080976:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000400:00000200:3.0:1767323579.080977:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1495:1495:254:4294967295] 192.168.204.130@tcp LPNI seq info [1495:1495:6:4294967295] 00000800:00000010:1.0:1767323579.080982:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012abb00. 00000400:00000200:1.0:1767323579.080986:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323579.080997:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323579.081002:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323579.081008:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323579.081011:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3c00. 00000800:00000200:3.0:1767323579.081020:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323579.081025:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000100:00000001:2.0:1767323579.081037:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000800:00000200:3.0:1767323579.081040:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3c00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323579.081042:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.081046:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323579.081051:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11846 usecs (12 jiffies) 00000100:00000001:3.0:1767323579.081054:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300795917 00000100:00000001:3.0:1767323579.081057:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300797166 00000100:00000001:3.0:1767323579.081059:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300795917 00000100:00000001:3.0:1767323579.081062:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300797166 00000100:00000001:3.0:1767323579.081064:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300795917 00000100:00000001:3.0:1767323579.081067:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300797166 00000100:00000001:3.0:1767323579.081069:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300795917 00000100:00000001:3.0:1767323579.081071:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300797166 00000100:00000001:3.0:1767323579.081073:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323579.081076:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.081079:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.081081:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1767323579.082978:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997ee0 00000400:00000010:1.0:1767323579.082984:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997ee0. 00000100:00000001:1.0:1767323579.082990:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323579.083000:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.083012:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323579.083016:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.083023:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323579.083025:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323579.083051:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323579.083055:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3000. 00000400:00000200:1.0:1767323579.083060:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323579.083064:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323579.083079:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecf68 00000400:00000010:1.0:1767323579.083081:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecf68. 00000100:00000001:1.0:1767323579.083083:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323579.083087:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.083095:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323579.083098:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.083104:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323579.083106:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323579.083334:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323579.083337:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3c00. 00000400:00000200:1.0:1767323579.083341:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323579.083345:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323579.083356:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec4c8 00000400:00000010:1.0:1767323579.083358:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec4c8. 00000100:00000001:1.0:1767323579.083361:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323579.083365:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.083373:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323579.083376:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.083405:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323579.083407:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:1.0:1767323579.087150:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087167:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323579.087172:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087174:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323579.087264:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323579.087282:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953e680 00000400:00000200:1.0:1767323579.087290:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x30a9 [1] + 224 00000800:00000001:1.0:1767323579.087298:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087316:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323579.087319:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323579.087324:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323579.087332:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323579.087340:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323579.087363:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323579.087467:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323579.087471:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323579.087525:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323579.087535:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087539:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323579.087541:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087543:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323579.087547:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323579.087554:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953e700 00000400:00000200:1.0:1767323579.087560:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x30b1 [1] + 224 00000800:00000001:1.0:1767323579.087564:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087568:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323579.087570:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323579.087573:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323579.087575:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323579.087580:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323579.087588:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.087597:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323579.087601:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087604:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323579.087606:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087608:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323579.087611:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323579.087624:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953e780 00000400:00000200:1.0:1767323579.087628:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x30b9 [1] + 224 00000800:00000001:1.0:1767323579.087632:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087638:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323579.087640:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323579.087643:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323579.087646:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323579.087651:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323579.087659:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323579.087666:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323579.087669:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323579.087672:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.087859:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323579.087871:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323579.087878:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323579.087880:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323579.087883:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328b58. 00000400:00000200:3.0:1767323579.087888:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecee0 00000400:00000010:3.0:1767323579.087891:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecee0. 00000100:00000001:3.0:1767323579.087894:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323579.087898:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323579.087913:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.087919:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323579.087922:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.087924:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323579.087926:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323579.087929:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323579.087931:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323579.087934:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323579.087943:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=31 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323579.087947:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=31 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323579.087949:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323579.087951:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323579.087954:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1767323579.087958:0:111003:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1767323579.087964:0:111003:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.087967:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323579.087969:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323579.087971:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323579.087972:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323579.087976:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.087981:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323579.087984:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323579.087986:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323579.087989:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323579.087995:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975841664:192.168.204.130@tcp:400:kworker.0 00000400:00000001:3.0:1767323579.088008:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323579.088009:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323579.088011:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328bb0. 00000400:00000200:3.0:1767323579.088013:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aeca18 00000400:00000010:3.0:1767323579.088015:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aeca18. 00000100:00000001:3.0:1767323579.088017:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323579.088020:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323579.088026:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.088032:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323579.088033:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.088035:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323579.088037:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323579.088038:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323579.088039:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323579.088041:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323579.088046:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=31 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323579.088048:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=31 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323579.088050:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323579.088051:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323579.088053:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323579.088055:0:111003:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.088057:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323579.088058:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323579.088060:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323579.088061:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323579.088064:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.088070:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323579.088072:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323579.088073:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323579.088076:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323579.088088:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975841536:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323579.088091:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.088094:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323579.088096:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3c380 x1853171975841664/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.088103:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323579.088105:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323579.088108:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410105c3c00. 02000000:00000001:3.0:1767323579.088111:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323579.088113:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323579.088115:0:111003:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323579.088117:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323579.088120:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c000. 02000000:00000001:3.0:1767323579.088123:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323579.088124:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323579.088126:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3c380. 00000100:00000001:3.0:1767323579.088129:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323579.088131:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.088132:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323579.088135:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3c700 x1853171975841536/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323579.088141:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323579.088142:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323579.088144:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410105c3e00. 02000000:00000001:3.0:1767323579.088145:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323579.088146:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323579.088148:0:111003:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323579.088150:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323579.088151:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cb00. 02000000:00000001:3.0:1767323579.088153:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323579.088154:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323579.088155:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3c700. 00000100:00000001:3.0:1767323579.088162:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323579.088163:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.088166:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323579.088174:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323579.088176:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323579.088178:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323579.088180:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:0.0:1767323579.088626:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323579.088628:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323579.088630:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107164d0. 00000400:00000200:0.0:1767323579.088634:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089976e8 00000400:00000010:0.0:1767323579.088636:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089976e8. 00000100:00000001:0.0:1767323579.088639:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323579.088644:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323579.088653:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323579.088658:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323579.088660:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323579.088662:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323579.088663:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323579.088665:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323579.088666:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323579.088668:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323579.088672:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=32 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323579.088675:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=32 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323579.088677:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323579.088678:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323579.088680:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323579.088682:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323579.088683:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323579.088695:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323579.088701:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323579.088703:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323579.088705:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323579.088708:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323579.088715:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975841408:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323579.088718:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323579.088720:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323579.088723:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3ce00 x1853171975841408/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323595 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323579.088729:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323579.088731:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323579.088733:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941003e8b800. 02000000:00000001:0.0:1767323579.088736:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323579.088737:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323579.088738:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:0.0:1767323579.088741:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323579.088742:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c100. 02000000:00000001:0.0:1767323579.088744:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323579.088745:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323579.088747:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3ce00. 00000100:00000001:0.0:1767323579.088749:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323579.088750:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323579.088752:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323579.088757:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323579.088758:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323579.088760:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323579.088761:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323579.659037:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323579.659043:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323579.659047:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323579.659063:0:127095:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323579.659064:0:127095:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323579.659068:0:127095:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323579.659070:0:127095:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323579.659071:0:127095:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323579.659073:0:127095:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323579.659075:0:127095:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323579.659076:0:127095:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323579.659078:0:127095:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323579.659152:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323579.659155:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323579.659157:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323580.359456:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300797166, at 4300797184 00000100:00000010:3.0:1767323580.359471:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2780. 00000100:00000040:2.0:1767323580.359569:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300797166, at 4300797184 00000100:00000010:2.0:1767323580.359577:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba25a0. 00000100:00000040:1.0:1767323580.359659:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300797166, at 4300797184 00000100:00000010:1.0:1767323580.359666:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba23c0. 00000100:00000040:0.0:1767323580.359808:0:127095:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300797166, at 4300797184 00000100:00000010:0.0:1767323580.359814:0:127095:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2180. 00010000:00000001:0.0:1767323580.681075:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323580.681081:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323580.681086:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323580.681087:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323580.681111:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323580.681113:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323580.681116:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323581.703512:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323581.703519:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323581.703524:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323581.703525:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323581.703615:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323581.703619:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323581.703622:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323582.727534:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323582.727544:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323582.727551:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323582.727552:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323582.727583:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323582.727587:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323582.727590:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323583.751530:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323583.751540:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323583.751547:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323583.751548:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323583.751617:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323583.751622:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323583.751626:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323584.199596:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323584.199609:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323584.199619:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be7800. 00000020:00000040:0.0:1767323584.199627:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323584.199648:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323584.199651:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323584.199657:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323584.199666:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abc00. 00000100:00000001:0.0:1767323584.199673:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.199687:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323584.199698:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323584.199702:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.199709:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d843ebae] to pc [ptlrpcd_00_00+0] req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.199742:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.199745:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323584.199748:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323584.199751:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5500. 00000020:00000040:0.0:1767323584.199753:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323584.199755:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323584.199757:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323584.199759:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323584.199761:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab700. 00000100:00000001:0.0:1767323584.199764:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.199768:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323584.199775:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323584.199778:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.199781:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005c8286d4] to pc [ptlrpcd_00_01+1] req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.199789:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.199791:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323584.199794:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323584.199803:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be7100. 00000020:00000040:0.0:1767323584.199806:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323584.199808:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323584.199810:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323584.199812:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323584.199815:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab900. 00000100:00000001:0.0:1767323584.199818:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.199823:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323584.199830:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323584.199832:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.199836:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3ea60ad] to pc [ptlrpcd_00_02+2] req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.199882:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323584.199887:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323584.199890:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323584.199896:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.199904:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323584.199906:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323584.199910:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323584.199913:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323584.199916:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323584.199920:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975842048:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323584.199924:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323584.199930:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323584.199933:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323584.199936:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323584.199952:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941004cece00. 02000000:00000001:3.0:1767323584.199954:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323584.199962:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328bb0. 00000400:00000010:3.0:1767323584.199971:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aeca18. 00000100:00000200:3.0:1767323584.199980:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975842048, portal 10 00000100:00000001:3.0:1767323584.199983:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323584.199985:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470921984 : -118678238629632 : ffff941011be7100) 00000100:00000040:3.0:1767323584.199993:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.200001:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323584.200010:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323584.200012:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecee0. 00000100:00000200:3.0:1767323584.200016:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975842048, offset 0 00000400:00000200:3.0:1767323584.200022:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323584.200036:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323584.200042:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323584.200047:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323584.200051:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323584.200054:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323584.200057:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1496:1496:256:4294967295] 192.168.204.130@tcp LPNI seq info [1496:1496:8:4294967295] 00000400:00000200:3.0:1767323584.200080:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323584.200087:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323584.200094:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3c00. 00000800:00000200:3.0:1767323584.200102:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323584.200111:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323584.200115:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3c00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323584.200131:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323584.200136:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11586 usecs (12 jiffies) 00000100:00000001:3.0:1767323584.200141:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300801036 00000100:00000010:3.0:1767323584.200145:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9410399071e0. 00000100:00000001:3.0:1767323584.200154:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:3.0:1767323584.200161:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300801036 00000100:00000010:3.0:1767323584.200165:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9410399079c0. 00000100:00000001:3.0:1767323584.200168:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:3.0:1767323584.200176:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300801036 00000100:00000010:3.0:1767323584.200180:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907300. 00000100:00000001:3.0:1767323584.200183:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:3.0:1767323584.200188:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300801036 00000100:00000010:3.0:1767323584.200191:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9410399077e0. 00000100:00000001:3.0:1767323584.200199:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:3.0:1767323584.200202:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323584.200206:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.200208:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.200211:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323584.200331:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323584.200336:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323584.200338:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323584.200345:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.200353:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323584.200355:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000040:0.0:1767323584.200358:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323584.200359:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323584.200364:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000040:0.0:1767323584.200366:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323584.200369:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323584.200372:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323584.200376:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6138) 02000000:00000001:1.0:1767323584.200378:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323584.200401:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323584.200405:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975841920:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323584.200410:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000100:00000001:0.0:1767323584.200411:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 02000000:00000001:1.0:1767323584.200414:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000100:00000001:0.0:1767323584.200415:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323584.200418:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323584.200421:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323584.200434:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410105c3a00. 02000000:00000001:1.0:1767323584.200436:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323584.200441:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156ec8. 00000400:00000010:1.0:1767323584.200446:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890acc0. 00000100:00000200:1.0:1767323584.200449:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975841920, portal 10 00000100:00000001:1.0:1767323584.200452:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323584.200453:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470914816 : -118678238636800 : ffff941011be5500) 00000100:00000040:1.0:1767323584.200460:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323584.200468:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323584.200471:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323584.200474:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a770. 00000100:00000200:1.0:1767323584.200476:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975841920, offset 0 00000400:00000200:1.0:1767323584.200481:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323584.200486:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323584.200489:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323584.200492:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323584.200495:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323584.200497:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323584.200500:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1497:1497:255:4294967295] 192.168.204.130@tcp LPNI seq info [1497:1497:7:4294967295] 00000400:00000200:1.0:1767323584.200507:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323584.200511:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323584.200515:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c600. 00000800:00000200:1.0:1767323584.200519:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323584.200524:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323584.200526:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323584.200529:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323584.200532:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 13295 usecs (14 jiffies) 00000100:00000001:1.0:1767323584.200534:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300801039 00000100:00000001:1.0:1767323584.200539:0:111002:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, simply extend its deadline from 4300801036 00000100:00000001:1.0:1767323584.200549:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300801039 00000100:00000001:1.0:1767323584.200552:0:111002:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, simply extend its deadline from 4300801036 00000100:00000001:1.0:1767323584.200555:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300801039 00000100:00000001:1.0:1767323584.200558:0:111002:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, simply extend its deadline from 4300801036 00000100:00000001:1.0:1767323584.200561:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300801039 00000100:00000001:1.0:1767323584.200563:0:111002:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, simply extend its deadline from 4300801036 00000100:00000001:1.0:1767323584.200566:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323584.200569:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323584.200571:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323584.200573:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323584.200592:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323584.200594:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323584.200597:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323584.200598:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323584.200600:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323584.200602:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000001:1.0:1767323584.200604:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323584.200606:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323584.200607:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323584.200609:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323584.200610:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323584.200611:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323584.200616:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323584.200624:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323584.200626:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323584.200628:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323584.200630:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323584.200633:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323584.200636:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975841792:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323584.200650:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323584.200652:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323584.200655:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323584.200656:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323584.200658:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.200660:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:3.0:1767323584.200709:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323584.200713:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3c00. 00000400:00000200:3.0:1767323584.200720:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000001:1.0:1767323584.200725:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000400:00000200:3.0:1767323584.200729:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 02000000:00000001:1.0:1767323584.200735:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000400:00000200:3.0:1767323584.200736:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecee0 02000000:00000001:1.0:1767323584.200738:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323584.200740:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecee0. 02000000:00000001:1.0:1767323584.200743:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:3.0:1767323584.200747:0:110994:0:(events.c:34:request_out_callback()) Process entered 02000000:00000010:1.0:1767323584.200748:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410105c3800. 02000000:00000001:1.0:1767323584.200752:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:3.0:1767323584.200755:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:1.0:1767323584.200758:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156d68. 00000400:00000010:1.0:1767323584.200765:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890af68. 00000100:00000001:3.0:1767323584.200769:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000200:1.0:1767323584.200770:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975841792, portal 25 00000100:00000001:1.0:1767323584.200774:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000040:3.0:1767323584.200776:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323584.200777:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470923776 : -118678238627840 : ffff941011be7800) 00000100:00000040:1.0:1767323584.200788:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.200789:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.200794:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:1.0:1767323584.200800:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323584.200803:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323584.200807:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890aee0. 00000100:00000200:1.0:1767323584.200810:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975841792, offset 0 00000400:00000200:1.0:1767323584.200815:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323584.200820:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323584.200824:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323584.200827:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323584.200829:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323584.200832:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323584.200836:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1498:1498:255:4294967295] 192.168.204.130@tcp LPNI seq info [1498:1498:7:4294967295] 00000400:00000200:1.0:1767323584.200844:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323584.200849:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323584.200853:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c800. 00000800:00000200:1.0:1767323584.200857:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323584.200862:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323584.200865:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c800 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323584.200868:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323584.200870:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300802286 00000100:00000001:1.0:1767323584.200875:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300801039 00000100:00000001:1.0:1767323584.200884:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300802286 00000100:00000001:1.0:1767323584.200887:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300801039 00000100:00000001:1.0:1767323584.200890:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300802286 00000100:00000001:1.0:1767323584.200892:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300801039 00000100:00000001:1.0:1767323584.200895:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300802286 00000100:00000001:1.0:1767323584.200898:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300801039 00000100:00000001:1.0:1767323584.200901:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323584.200903:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323584.200906:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323584.200908:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323584.201112:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323584.201116:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:3.0:1767323584.201376:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323584.201379:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c600. 00000400:00000200:3.0:1767323584.201411:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323584.201416:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323584.201419:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a770 00000400:00000010:3.0:1767323584.201421:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a770. 00000100:00000001:3.0:1767323584.201425:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323584.201429:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.201448:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323584.201451:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.201457:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.201458:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:3.0:1767323584.201708:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323584.201711:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c800. 00000400:00000200:3.0:1767323584.201714:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323584.201718:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323584.201721:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890aee0 00000400:00000010:3.0:1767323584.201723:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890aee0. 00000100:00000001:3.0:1767323584.201725:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323584.201729:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.201736:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323584.201738:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.201744:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.201746:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:1.0:1767323584.205751:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.205777:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323584.205781:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.205784:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323584.205798:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323584.205820:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953e900 00000400:00000200:1.0:1767323584.205830:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x30c1 [1] + 224 00000800:00000001:1.0:1767323584.205840:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.205845:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323584.205848:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323584.205853:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323584.205864:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323584.205874:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323584.205886:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323584.205906:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323584.205919:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.205924:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323584.205925:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.205946:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323584.205951:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323584.205958:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953e880 00000400:00000200:1.0:1767323584.205964:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x30c9 [1] + 224 00000800:00000001:1.0:1767323584.205968:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.205972:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323584.205974:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323584.205977:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323584.205980:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323584.205985:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323584.205994:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323584.206018:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323584.206022:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.206025:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323584.206027:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.206030:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323584.206033:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323584.206039:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953e800 00000400:00000200:1.0:1767323584.206046:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x30d1 [1] + 224 00000800:00000001:1.0:1767323584.206050:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.206057:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323584.206060:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323584.206064:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323584.206066:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323584.206070:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.206073:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323584.206079:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000040:1.0:1767323584.206083:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323584.206104:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323584.206109:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323584.206113:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000001:0.0:1767323584.206161:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323584.206164:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323584.206168:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156d68. 00000400:00000200:0.0:1767323584.206173:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890af68 00000400:00000010:0.0:1767323584.206177:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890af68. 00000100:00000001:0.0:1767323584.206181:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323584.206186:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323584.206209:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.206224:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323584.206226:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323584.206229:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323584.206233:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323584.206236:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323584.206238:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323584.206242:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323584.206250:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=37 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323584.206265:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=37 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323584.206269:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323584.206270:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323584.206274:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323584.206277:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323584.206280:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.206284:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.206292:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323584.206295:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323584.206298:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323584.206301:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323584.206309:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975841792:192.168.204.130@tcp:400:kworker.0 00000400:00000001:0.0:1767323584.206316:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323584.206317:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323584.206319:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156ec8. 00000400:00000200:0.0:1767323584.206322:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890acc0 00000400:00000010:0.0:1767323584.206324:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890acc0. 00000100:00000001:0.0:1767323584.206326:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323584.206329:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323584.206343:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.206349:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323584.206355:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323584.206357:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323584.206359:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323584.206360:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323584.206362:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323584.206363:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323584.206369:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=36 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323584.206373:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=36 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323584.206375:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323584.206376:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323584.206378:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323584.206415:0:111002:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323584.206419:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323584.206422:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323584.206424:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323584.206426:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323584.206430:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.206436:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323584.206438:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323584.206439:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323584.206443:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323584.206450:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975841920:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323584.206455:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323584.206459:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323584.206462:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be7800 x1853171975841792/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.206478:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323584.206481:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323584.206485:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410105c3800. 02000000:00000001:0.0:1767323584.206489:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323584.206493:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323584.206495:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:0.0:1767323584.206497:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323584.206500:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abc00. 02000000:00000001:0.0:1767323584.206506:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323584.206507:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323584.206510:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be7800. 00000100:00000001:0.0:1767323584.206514:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323584.206515:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323584.206517:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323584.206521:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5500 x1853171975841920/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323584.206526:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323584.206528:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323584.206530:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410105c3a00. 02000000:00000001:0.0:1767323584.206532:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323584.206533:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323584.206534:0:111002:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323584.206536:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323584.206537:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab700. 02000000:00000001:0.0:1767323584.206539:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323584.206541:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323584.206542:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5500. 00000100:00000001:0.0:1767323584.206545:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323584.206546:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323584.206548:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323584.206557:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323584.206559:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323584.206561:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323584.206564:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.206623:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323584.206626:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323584.206630:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323584.206632:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323584.206635:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328bb0. 00000400:00000200:3.0:1767323584.206639:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aeca18 00000400:00000010:3.0:1767323584.206641:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aeca18. 00000100:00000001:3.0:1767323584.206644:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323584.206649:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323584.206658:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.206675:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323584.206676:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323584.206678:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323584.206680:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323584.206681:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323584.206682:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323584.206684:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323584.206689:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=36 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323584.206692:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=36 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323584.206694:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323584.206696:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323584.206697:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1767323584.206701:0:111003:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1767323584.206708:0:111003:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.206710:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323584.206712:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323584.206713:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323584.206715:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323584.206718:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.206725:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323584.206726:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323584.206728:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323584.206731:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323584.206738:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975842048:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323584.206743:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323584.206745:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323584.206747:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be7100 x1853171975842048/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323600 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323584.206757:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323584.206759:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323584.206761:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941004cece00. 02000000:00000001:3.0:1767323584.206763:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323584.206764:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323584.206766:0:111003:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323584.206778:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323584.206780:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab900. 02000000:00000001:3.0:1767323584.206782:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323584.206784:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323584.206785:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be7100. 00000100:00000001:3.0:1767323584.206788:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323584.206789:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323584.206791:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323584.206796:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323584.206797:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323584.206799:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323584.206801:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323584.775536:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323584.775566:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323584.775572:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323584.775573:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323584.775601:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323584.775603:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323584.775605:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323585.479554:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300802286, at 4300802304 00000100:00000040:0.0:1767323585.479555:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300802286, at 4300802304 00000100:00000010:2.0:1767323585.479574:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907300. 00000100:00000010:0.0:1767323585.479578:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9410399071e0. 00000100:00000040:1.0:1767323585.479713:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300802286, at 4300802304 00000100:00000040:3.0:1767323585.479715:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300802286, at 4300802304 00000100:00000010:1.0:1767323585.479726:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9410399079c0. 00000100:00000010:3.0:1767323585.479729:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9410399077e0. 00010000:00000001:0.0:1767323585.799611:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323585.799623:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323585.799630:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323585.799632:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323585.799861:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323585.799866:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323585.799869:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323586.823601:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323586.823611:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323586.823617:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323586.823619:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323586.823651:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323586.823655:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323586.823658:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323587.848579:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323587.848592:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323587.848595:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323587.848598:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323587.848603:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323587.848606:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323587.848609:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323587.848612:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323587.848616:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323587.848618:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323587.848809:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323587.848813:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323587.848817:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323588.876929:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323588.876938:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323588.876944:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323588.876945:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323588.876970:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323588.876973:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323588.876977:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323589.320193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323589.320205:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323589.320218:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f12300. 00000020:00000040:2.0:1767323589.320226:0:8:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:2.0:1767323589.320231:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1767323589.320235:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1767323589.320240:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323589.320249:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7100. 00000100:00000001:2.0:1767323589.320256:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.320379:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1767323589.320511:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1767323589.320530:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.320539:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000288d4bad] to pc [ptlrpcd_00_03+3] req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323589.320670:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323589.321003:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323589.321007:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323589.321013:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323589.321021:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323589.321023:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323589.321027:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323589.321030:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323589.321033:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323589.321036:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975842176:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323589.321039:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323589.321045:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323589.321047:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323589.321050:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323589.321055:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010e19000. 02000000:00000001:0.0:1767323589.321057:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323589.321063:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107164d0. 00000400:00000010:0.0:1767323589.321069:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089976e8. 00000100:00000200:0.0:1767323589.321077:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975842176, portal 25 00000100:00000001:0.0:1767323589.321079:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323589.321081:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145332992 : -118677564218624 : ffff941039f12300) 00000100:00000040:0.0:1767323589.321086:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323589.321093:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323589.321095:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323589.321098:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997e58. 00000100:00000200:0.0:1767323589.321101:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975842176, offset 0 00000400:00000200:0.0:1767323589.321106:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323589.321120:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323589.321125:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323589.321129:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323589.321133:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323589.321135:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323589.321146:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1499:1499:256:4294967295] 192.168.204.130@tcp LPNI seq info [1499:1499:8:4294967295] 00000400:00000200:0.0:1767323589.321170:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323589.321178:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323589.321183:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab700. 00000800:00000200:0.0:1767323589.321190:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323589.321199:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323589.321204:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323589.321228:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323589.321234:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300807406 00000100:00000010:0.0:1767323589.321238:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2e40. 00000100:00000001:0.0:1767323589.321246:0:111004:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:0.0:1767323589.321254:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300807406 00000100:00000010:0.0:1767323589.321257:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2540. 00000100:00000001:1.0:1767323589.322091:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323589.322097:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323589.322128:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.322132:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323589.322137:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323589.322144:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f12a00. 00000020:00000040:2.0:1767323589.322148:0:8:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:2.0:1767323589.322153:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1767323589.322156:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1767323589.322169:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323589.322176:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7e00. 00000100:00000001:2.0:1767323589.322181:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.322190:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1767323589.322199:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1767323589.322203:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.322208:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000011c97bb8] to pc [ptlrpcd_00_00+0] req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.322250:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323589.322253:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323589.322255:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323589.322273:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.322280:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323589.322282:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323589.322285:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323589.322288:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323589.322290:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323589.322294:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975842304:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323589.322298:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323589.322301:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323589.322304:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323589.322306:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323589.322310:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410105c3c00. 02000000:00000001:1.0:1767323589.322312:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323589.322317:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156e70. 00000400:00000010:1.0:1767323589.322324:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890ad48. 00000100:00000200:1.0:1767323589.322330:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975842304, portal 10 00000100:00000001:1.0:1767323589.322341:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323589.322343:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145334784 : -118677564216832 : ffff941039f12a00) 00000100:00000040:1.0:1767323589.322350:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.322357:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323589.322360:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323589.322362:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a5d8. 00000100:00000200:1.0:1767323589.322365:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975842304, offset 0 00000400:00000200:1.0:1767323589.322370:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323589.322380:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323589.322403:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323589.322407:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323589.322410:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323589.322413:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323589.322416:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1500:1500:255:4294967295] 192.168.204.130@tcp LPNI seq info [1500:1500:7:4294967295] 00000400:00000200:1.0:1767323589.322426:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323589.322431:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323589.322438:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c800. 00000800:00000200:1.0:1767323589.322444:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323589.322450:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323589.322454:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c800 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323589.322457:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323589.322462:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12955 usecs (13 jiffies) 00000100:00000001:1.0:1767323589.322464:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300806159 00000100:00000001:1.0:1767323589.322467:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300807406 00000100:00000001:1.0:1767323589.322470:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300806159 00000800:00000200:3.0:1767323589.322840:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323589.322845:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab700. 00000400:00000200:3.0:1767323589.322852:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323589.322858:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323589.322863:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997e58 00000400:00000010:3.0:1767323589.322865:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997e58. 00000100:00000001:3.0:1767323589.322869:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323589.322874:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323589.322883:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323589.322887:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323589.322894:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323589.322903:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:3.0:1767323589.322969:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323589.322972:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c800. 00000400:00000200:3.0:1767323589.322975:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323589.322979:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323589.322982:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a5d8 00000400:00000010:3.0:1767323589.322984:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a5d8. 00000100:00000001:3.0:1767323589.322987:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323589.322991:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323589.322999:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323589.323002:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323589.323008:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323589.323010:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:2.0:1767323589.323087:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.323091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323589.323095:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323589.323099:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f11180. 00000020:00000040:2.0:1767323589.323103:0:8:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:2.0:1767323589.323106:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1767323589.323107:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1767323589.323110:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323589.323115:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7500. 00000100:00000001:2.0:1767323589.323119:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.323124:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1767323589.323145:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1767323589.323148:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.323153:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ac42371] to pc [ptlrpcd_00_01+1] req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323589.323181:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.323185:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1767323589.323188:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:2.0:1767323589.323191:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1767323589.323194:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:2.0:1767323589.323199:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6143) 00000100:00000001:1.0:1767323589.323337:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323589.323340:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323589.323342:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323589.323349:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.323362:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323589.323363:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323589.323366:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323589.323368:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323589.323370:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323589.323373:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975842432:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323589.323377:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323589.323380:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323589.323396:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323589.323398:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323589.323402:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410105c3e00. 02000000:00000001:1.0:1767323589.323404:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323589.323408:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156e18. 00000400:00000010:1.0:1767323589.323413:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a330. 00000100:00000200:1.0:1767323589.323417:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975842432, portal 10 00000100:00000001:1.0:1767323589.323420:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323589.323421:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145328512 : -118677564223104 : ffff941039f11180) 00000100:00000040:1.0:1767323589.323427:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.323434:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323589.323436:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323589.323438:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a908. 00000100:00000200:1.0:1767323589.323441:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975842432, offset 0 00000400:00000200:1.0:1767323589.323445:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323589.323453:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323589.323457:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323589.323460:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323589.323463:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323589.323465:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323589.323467:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1501:1501:256:4294967295] 192.168.204.130@tcp LPNI seq info [1501:1501:8:4294967295] 00000400:00000200:1.0:1767323589.323475:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323589.323486:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323589.323490:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c600. 00000800:00000200:1.0:1767323589.323494:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323589.323499:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323589.323502:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323589.323521:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323589.323525:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11282 usecs (12 jiffies) 00000100:00000001:1.0:1767323589.323528:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300806159 00000100:00000001:1.0:1767323589.323531:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300807406 00000100:00000001:1.0:1767323589.323533:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300806159 00000100:00000001:0.0:1767323589.323648:0:111004:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:0.0:1767323589.323656:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300807409 00000100:00000010:0.0:1767323589.323660:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2840. 00000100:00000001:0.0:1767323589.323664:0:111004:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1767323589.323666:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300807409 00000100:00000010:0.0:1767323589.323668:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2180. 00000100:00000001:0.0:1767323589.323670:0:111004:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1767323589.323672:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323589.323674:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323589.323676:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323589.323678:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323589.323684:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323589.323686:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323589.323687:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323589.323688:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323589.323689:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323589.323690:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1767323589.323905:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323589.323907:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c600. 00000400:00000200:2.0:1767323589.323911:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323589.323914:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323589.323916:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a908 00000400:00000010:2.0:1767323589.323918:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a908. 00000100:00000001:2.0:1767323589.323920:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323589.323923:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323589.323929:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323589.323931:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323589.323935:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323589.323936:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:3.0:1767323589.323986:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300807406 00000100:00000001:3.0:1767323589.324106:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300806161 00000100:00000001:3.0:1767323589.324109:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300807409 00000100:00000001:3.0:1767323589.324111:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300806161 00000100:00000001:3.0:1767323589.324112:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300807409 00000100:00000001:3.0:1767323589.324115:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323589.324117:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323589.324120:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323589.324121:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323589.324126:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323589.324127:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323589.324129:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323589.324131:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323589.324132:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323589.324134:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323589.324430:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300807406 00000100:00000001:1.0:1767323589.324434:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300806161 00000100:00000001:1.0:1767323589.324437:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300807409 00000100:00000001:1.0:1767323589.324438:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300806161 00000100:00000001:1.0:1767323589.324441:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300807409 00000100:00000001:1.0:1767323589.324442:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323589.324445:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323589.324447:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323589.324448:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323589.324453:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323589.324454:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323589.324456:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323589.324457:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323589.324458:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323589.324460:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:1.0:1767323589.330860:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323589.330881:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323589.330886:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323589.330888:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323589.330900:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323589.330939:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953e980 00000400:00000200:1.0:1767323589.330949:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x30d9 [1] + 224 00000800:00000001:1.0:1767323589.330957:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323589.330967:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323589.330970:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323589.330974:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323589.330981:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323589.330992:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323589.331004:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.331031:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323589.331042:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323589.331046:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323589.331669:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323589.331679:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323589.331681:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323589.331690:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323589.331694:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323589.331702:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ea00 00000400:00000200:3.0:1767323589.331708:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x30e1 [1] + 224 00000800:00000001:3.0:1767323589.331711:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323589.331713:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323589.331714:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323589.331716:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323589.331720:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323589.331724:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323589.331730:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323589.331747:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323589.331752:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323589.331755:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323589.331756:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323589.331758:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323589.331762:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323589.331767:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ea80 00000400:00000200:3.0:1767323589.331771:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x30e9 [1] + 224 00000800:00000001:3.0:1767323589.331775:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323589.331779:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323589.331780:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323589.331784:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323589.331786:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323589.331791:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323589.331800:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323589.331835:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323589.331840:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323589.331844:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323589.332077:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323589.332081:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323589.332088:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323589.332090:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323589.332093:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156e70. 00000400:00000200:1.0:1767323589.332098:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890ad48 00000400:00000010:1.0:1767323589.332100:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890ad48. 00000100:00000001:1.0:1767323589.332104:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323589.332109:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323589.332119:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.332126:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323589.332128:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323589.332131:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323589.332135:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323589.332137:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323589.332139:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323589.332143:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323589.332170:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=41 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323589.332175:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=41 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323589.332178:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323589.332180:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323589.332184:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323589.332188:0:111001:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323589.332191:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323589.332194:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323589.332196:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323589.332198:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323589.332203:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.332211:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323589.332214:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323589.332216:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323589.332220:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323589.332228:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975842304:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323589.332233:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323589.332235:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323589.332238:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f12a00 x1853171975842304/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323589.332245:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323589.332247:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323589.332251:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410105c3c00. 02000000:00000001:1.0:1767323589.332254:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323589.332257:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323589.332259:0:111001:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:1.0:1767323589.332261:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323589.332264:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7e00. 02000000:00000001:1.0:1767323589.332268:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323589.332270:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323589.332277:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f12a00. 00000100:00000001:1.0:1767323589.332280:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323589.332282:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323589.332285:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323589.332293:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323589.332295:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323589.332297:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323589.332300:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323589.332862:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323589.332872:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1767323589.332877:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323589.332879:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323589.332881:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107164d0. 00000400:00000200:0.0:1767323589.332885:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089976e8 00000400:00000010:0.0:1767323589.332888:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089976e8. 00000100:00000001:0.0:1767323589.332891:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323589.332898:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323589.332907:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323589.332914:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323589.332915:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323589.332917:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323589.332919:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323589.332921:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323589.332922:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323589.332924:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323589.332929:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=42 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323589.332932:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=42 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323589.332934:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323589.332936:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323589.332938:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323589.332940:0:111004:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323589.332942:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323589.332945:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323589.332952:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323589.332955:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323589.332956:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323589.332959:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323589.332967:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975842176:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323589.332978:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323589.332980:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323589.332985:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f12300 x1853171975842176/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323589.332991:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323589.332993:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323589.332995:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010e19000. 02000000:00000001:0.0:1767323589.332999:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323589.333000:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323589.333002:0:111004:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:0.0:1767323589.333004:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323589.333006:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7100. 02000000:00000001:0.0:1767323589.333009:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323589.333010:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323589.333012:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f12300. 00000100:00000001:0.0:1767323589.333015:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323589.333016:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323589.333018:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323589.333023:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323589.333025:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323589.333027:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323589.333029:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323589.333252:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323589.333255:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323589.333259:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323589.333261:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323589.333269:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156e18. 00000400:00000200:2.0:1767323589.333273:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a330 00000400:00000010:2.0:1767323589.333275:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a330. 00000100:00000001:2.0:1767323589.333278:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323589.333283:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323589.333292:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323589.333299:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323589.333301:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323589.333303:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323589.333304:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323589.333306:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323589.333307:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323589.333309:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323589.333314:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=41 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323589.333317:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=41 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323589.333320:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323589.333321:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323589.333323:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323589.333327:0:111002:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323589.333334:0:111002:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323589.333337:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323589.333340:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323589.333341:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323589.333343:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323589.333347:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323589.333353:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323589.333355:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323589.333357:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323589.333360:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323589.333373:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975842432:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323589.333377:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323589.333379:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323589.333411:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f11180 x1853171975842432/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323605 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323589.333419:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323589.333420:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323589.333422:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410105c3e00. 02000000:00000001:2.0:1767323589.333425:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323589.333426:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323589.333428:0:111002:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323589.333430:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323589.333431:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7500. 02000000:00000001:2.0:1767323589.333433:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323589.333434:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323589.333436:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f11180. 00000100:00000001:2.0:1767323589.333438:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323589.333439:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323589.333441:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323589.333444:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323589.333446:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323589.333448:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323589.333449:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323589.895910:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323589.895916:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323589.895922:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323589.895926:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323589.895928:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323589.895932:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323589.895934:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323589.895936:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323589.895939:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323589.895941:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323589.895943:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323589.895945:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323589.901337:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323589.901343:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323589.901348:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323590.599562:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300807409, at 4300807424 00000100:00000010:3.0:1767323590.599582:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2180. 00000100:00000040:2.0:1767323590.599684:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300807409, at 4300807424 00000100:00000010:2.0:1767323590.599691:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2840. 00000100:00000040:1.0:1767323590.599881:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300807406, at 4300807424 00000100:00000010:1.0:1767323590.599898:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2540. 00000100:00000040:0.0:1767323590.600351:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300807406, at 4300807424 00000100:00000010:0.0:1767323590.600359:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2e40. 00010000:00000001:0.0:1767323590.920314:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323590.920324:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323590.920332:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323590.920334:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323590.920370:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323590.920374:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323590.920378:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323591.943499:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323591.943509:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323591.943518:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323591.943519:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323591.943875:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323591.943879:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323591.943883:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323592.967715:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323592.967726:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323592.967733:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323592.967734:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323592.967769:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323592.967773:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323592.967776:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323593.991553:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323593.991564:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323593.991573:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323593.991574:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323593.991663:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323593.991668:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323593.991671:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323594.439717:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323594.439731:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323594.439745:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5500. 00000020:00000040:0.0:1767323594.439753:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323594.439758:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323594.439762:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323594.439769:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323594.439778:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abc00. 00000100:00000001:0.0:1767323594.439786:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.439802:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323594.439814:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323594.439820:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.439848:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005c8286d4] to pc [ptlrpcd_00_02+2] req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323594.439892:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.439896:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323594.439899:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323594.439903:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be7800. 00000020:00000040:0.0:1767323594.439906:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323594.439908:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323594.439910:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323594.439912:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323594.439918:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab700. 00000100:00000001:0.0:1767323594.439922:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.439927:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323594.439934:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323594.439936:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.439939:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d843ebae] to pc [ptlrpcd_00_03+3] req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323594.439947:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.439950:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323594.439953:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323594.439956:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be7b80. 00000020:00000040:0.0:1767323594.439958:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323594.439960:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323594.439961:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323594.439963:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323594.439966:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab900. 00000100:00000001:0.0:1767323594.439969:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.439973:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323594.439994:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323594.439996:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.440001:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000232c701b] to pc [ptlrpcd_00_00+0] req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323594.440029:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323594.440032:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323594.440036:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323594.440039:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323594.440043:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323594.440049:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6148) 00000100:00000001:2.0:1767323594.440135:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323594.440140:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323594.440143:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323594.440152:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.440162:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323594.440164:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.440176:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323594.440180:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323594.440183:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323594.440187:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975842688:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323594.440193:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323594.440200:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323594.440204:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.440207:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323594.440211:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fe00. 02000000:00000001:2.0:1767323594.440213:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323594.440231:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323594.440246:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc33b8. 00000100:00000200:2.0:1767323594.440256:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975842688, portal 10 00000100:00000001:2.0:1767323594.440259:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323594.440261:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470923776 : -118678238627840 : ffff941011be7800) 00000100:00000040:2.0:1767323594.440269:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.440279:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323594.440282:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323594.440285:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3110. 00000100:00000200:2.0:1767323594.440289:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975842688, offset 0 00000400:00000200:2.0:1767323594.440297:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323594.440314:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323594.440321:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323594.440326:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323594.440331:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323594.440335:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323594.440338:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1502:1502:256:4294967295] 192.168.204.130@tcp LPNI seq info [1502:1502:8:4294967295] 00000400:00000200:2.0:1767323594.440349:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323594.440355:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323594.440360:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7500. 00000800:00000200:2.0:1767323594.440371:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323594.440378:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323594.440408:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7500 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323594.440419:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323594.440423:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12920 usecs (13 jiffies) 00000100:00000001:2.0:1767323594.440427:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300811278 00000100:00000010:2.0:1767323594.440430:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49240. 00000100:00000001:2.0:1767323594.440438:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:2.0:1767323594.440446:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300811278 00000100:00000010:2.0:1767323594.440449:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a499c0. 00000100:00000001:2.0:1767323594.440451:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:2.0:1767323594.440455:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300811278 00000100:00000010:2.0:1767323594.440457:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49600. 00000100:00000001:2.0:1767323594.440459:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:2.0:1767323594.440461:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300811278 00000100:00000010:2.0:1767323594.440464:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49de0. 00000100:00000001:2.0:1767323594.440466:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:2.0:1767323594.440470:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323594.440472:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.440475:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.440477:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.440491:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323594.440492:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323594.440494:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323594.440495:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323594.440496:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323594.440498:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000001:2.0:1767323594.440499:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.440500:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323594.440501:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.440502:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323594.440507:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323594.440508:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323594.440512:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.440517:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323594.440518:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.440520:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323594.440522:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323594.440523:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323594.440524:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975842560:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323594.440527:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323594.440529:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323594.440530:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.440532:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323594.440534:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fa00. 02000000:00000001:2.0:1767323594.440535:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323594.440538:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35d10. 00000400:00000010:2.0:1767323594.440541:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3bb0. 00000100:00000200:2.0:1767323594.440544:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975842560, portal 25 00000100:00000001:2.0:1767323594.440546:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323594.440547:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470914816 : -118678238636800 : ffff941011be5500) 00000100:00000040:2.0:1767323594.440550:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.440555:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323594.440557:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323594.440558:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc32a8. 00000100:00000200:2.0:1767323594.440560:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975842560, offset 0 00000400:00000200:2.0:1767323594.440563:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323594.440566:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323594.440568:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323594.440570:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323594.440572:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323594.440573:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323594.440579:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1503:1503:255:4294967295] 192.168.204.130@tcp LPNI seq info [1503:1503:7:4294967295] 00000400:00000200:2.0:1767323594.440585:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323594.440589:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323594.440592:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7600. 00000800:00000200:2.0:1767323594.440594:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323594.440597:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323594.440599:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323594.440601:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.440603:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300812526 00000100:00000001:2.0:1767323594.440608:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300811278 00000100:00000001:2.0:1767323594.440611:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300812526 00000100:00000001:2.0:1767323594.440612:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300811278 00000100:00000001:2.0:1767323594.440614:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300812526 00000100:00000001:2.0:1767323594.440616:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300811278 00000100:00000001:2.0:1767323594.440618:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300812526 00000100:00000001:2.0:1767323594.440620:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300811278 00000100:00000001:2.0:1767323594.440622:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323594.440623:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.440624:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.440625:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.440633:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:2.0:1767323594.440635:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000001:2.0:1767323594.440636:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.440639:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323594.440640:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.440641:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323594.440642:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323594.440643:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323594.440647:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000200:0.0:1767323594.440648:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323594.440652:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7500. 00000400:00000200:0.0:1767323594.440658:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323594.440666:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323594.440671:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3110 00000400:00000010:0.0:1767323594.440674:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3110. 00000100:00000001:2.0:1767323594.440679:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323594.440679:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000001:2.0:1767323594.440680:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.440684:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000200:0.0:1767323594.440685:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:2.0:1767323594.440686:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323594.440690:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323594.440697:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975842816:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323594.440700:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000100:00000001:0.0:1767323594.440700:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 02000000:00000001:2.0:1767323594.440704:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000100:00000040:0.0:1767323594.440705:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:2.0:1767323594.440706:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.440710:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323594.440713:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743ec00. 02000000:00000001:2.0:1767323594.440716:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323594.440716:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323594.440720:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000400:00000010:2.0:1767323594.440722:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35268. 00000400:00000010:2.0:1767323594.440726:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3aa0. 00000100:00000200:2.0:1767323594.440729:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975842816, portal 10 00000100:00000001:2.0:1767323594.440730:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323594.440732:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470924672 : -118678238626944 : ffff941011be7b80) 00000800:00000200:0.0:1767323594.440733:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323594.440736:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7600. 00000400:00000200:0.0:1767323594.440738:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000100:00000040:2.0:1767323594.440739:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323594.440743:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:2.0:1767323594.440747:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323594.440752:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323594.440752:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc32a8 00000400:00000010:2.0:1767323594.440754:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3110. 00000400:00000010:0.0:1767323594.440755:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc32a8. 00000100:00000001:0.0:1767323594.440759:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323594.440760:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975842816, offset 0 00000100:00000200:0.0:1767323594.440764:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1767323594.440769:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:0.0:1767323594.440776:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000400:00000200:2.0:1767323594.440777:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000100:00000040:0.0:1767323594.440781:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1767323594.440782:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323594.440788:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323594.440792:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000100:00000001:0.0:1767323594.440796:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1767323594.440797:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000001:0.0:1767323594.440799:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000400:00000200:2.0:1767323594.440802:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1504:1504:255:4294967295] 192.168.204.130@tcp LPNI seq info [1504:1504:7:4294967295] 00000400:00000200:2.0:1767323594.440807:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:1.0:1767323594.440843:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323594.440847:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323594.441796:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323594.441800:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1767323594.443091:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323594.443099:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7700. 00000800:00000200:2.0:1767323594.443109:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323594.443118:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323594.443123:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323594.443138:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323594.443146:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11407 usecs (12 jiffies) 00000100:00000001:2.0:1767323594.443152:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300811279 00000100:00000001:2.0:1767323594.443156:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300812526 00000100:00000001:2.0:1767323594.443159:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300811279 00000100:00000001:2.0:1767323594.443161:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300812526 00000100:00000001:2.0:1767323594.443164:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300811279 00000100:00000001:2.0:1767323594.443166:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300812526 00000100:00000001:2.0:1767323594.443168:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300811279 00000100:00000001:2.0:1767323594.443171:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300812526 00000100:00000001:2.0:1767323594.443175:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323594.443179:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.443184:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.443188:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323594.443975:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323594.443982:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7700. 00000400:00000200:1.0:1767323594.443989:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323594.443997:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323594.444006:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3110 00000400:00000010:1.0:1767323594.444009:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3110. 00000100:00000001:1.0:1767323594.444015:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323594.444025:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323594.444040:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323594.444044:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323594.444052:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323594.444054:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1767323594.447667:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323594.447695:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323594.447700:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323594.447703:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323594.447718:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323594.447742:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953eb80 00000400:00000200:3.0:1767323594.447755:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x30f1 [1] + 224 00000800:00000001:3.0:1767323594.447766:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323594.447772:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323594.447776:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323594.447780:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323594.447789:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323594.447800:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323594.447812:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323594.447834:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323594.447845:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323594.447849:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323594.447851:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323594.447853:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323594.447858:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323594.447864:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953eb00 00000400:00000200:3.0:1767323594.447890:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x30f9 [1] + 224 00000100:00000001:2.0:1767323594.447894:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000800:00000001:3.0:1767323594.447895:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000100:00000001:2.0:1767323594.447901:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000800:00000001:3.0:1767323594.447905:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323594.447909:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000001:2.0:1767323594.447911:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000200:3.0:1767323594.447914:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000001:2.0:1767323594.447915:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323594.447921:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323594.447927:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc33b8 00000400:00000010:2.0:1767323594.447930:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc33b8. 00000100:00000001:2.0:1767323594.447933:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323594.447940:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323594.447950:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.447966:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323594.447968:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323594.447972:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000001:2.0:1767323594.447972:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323594.447978:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000200:3.0:1767323594.447981:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.447983:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323594.447987:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.447993:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323594.447997:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323594.448006:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00001000:2.0:1767323594.448007:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=46 v=5 (5 0 0 0) 00000800:00000001:3.0:1767323594.448012:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000100:00001000:2.0:1767323594.448014:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=46 v=5 (1 0 0 0) 00000800:00000001:3.0:1767323594.448017:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.448019:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323594.448023:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323594.448027:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323594.448032:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.448037:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323594.448040:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323594.448041:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323594.448044:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323594.448192:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.448202:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323594.448206:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323594.448209:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323594.448213:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323594.448230:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975842688:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323594.448236:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.448373:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323594.448379:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be7800 x1853171975842688/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.448410:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323594.448413:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323594.448475:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fe00. 02000000:00000001:2.0:1767323594.448479:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323594.448483:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323594.448489:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323594.448491:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323594.448494:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab700. 02000000:00000001:2.0:1767323594.448500:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323594.448502:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323594.448504:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be7800. 00000100:00000001:2.0:1767323594.448510:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323594.448512:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.448516:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.448519:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323594.448521:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323594.448525:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323594.448526:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323594.448528:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35d10. 00000400:00000200:2.0:1767323594.448530:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3bb0 00000400:00000010:2.0:1767323594.448532:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3bb0. 00000100:00000001:2.0:1767323594.448534:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323594.448538:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323594.448546:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.448553:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323594.448555:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.448556:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323594.448557:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323594.448559:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323594.448560:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.448562:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323594.448565:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=47 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323594.448568:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=47 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323594.448571:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323594.448572:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323594.448574:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323594.448582:0:111004:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.448584:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323594.448589:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.448595:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323594.448597:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323594.448598:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323594.448602:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323594.448609:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975842560:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323594.448614:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.448616:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323594.448619:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5500 x1853171975842560/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.448624:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323594.448626:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323594.448628:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fa00. 02000000:00000001:2.0:1767323594.448630:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323594.448632:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323594.448633:0:111004:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:2.0:1767323594.448635:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323594.448637:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abc00. 02000000:00000001:2.0:1767323594.448640:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323594.448641:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323594.448642:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5500. 00000100:00000001:2.0:1767323594.448646:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323594.448647:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.448649:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.448663:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323594.448665:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.448668:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323594.448669:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323594.449797:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323594.449817:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323594.449821:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323594.449824:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323594.449836:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323594.449854:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ec00 00000400:00000200:0.0:1767323594.449863:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3101 [1] + 224 00000800:00000001:0.0:1767323594.449869:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323594.449877:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323594.449880:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323594.449884:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323594.449891:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323594.449901:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323594.449913:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323594.449936:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323594.449944:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323594.449947:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.449993:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323594.450010:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323594.450016:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323594.450018:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323594.450021:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35268. 00000400:00000200:2.0:1767323594.450026:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3aa0 00000400:00000010:2.0:1767323594.450029:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3aa0. 00000100:00000001:2.0:1767323594.450032:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323594.450037:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323594.450045:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.450188:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323594.450190:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.450192:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323594.450194:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323594.450196:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323594.450199:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323594.450201:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323594.450209:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=46 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323594.450212:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=46 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323594.450214:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323594.450217:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323594.450226:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323594.450231:0:111002:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323594.450323:0:111002:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.450328:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323594.450331:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323594.450333:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323594.450335:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323594.450340:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.450347:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323594.450357:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323594.450359:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323594.450364:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323594.450372:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975842816:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323594.450377:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.450379:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323594.450414:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be7b80 x1853171975842816/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323610 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323594.450433:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323594.450436:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323594.450439:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743ec00. 02000000:00000001:2.0:1767323594.450442:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323594.450445:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323594.450447:0:111002:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323594.450449:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323594.450451:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab900. 02000000:00000001:2.0:1767323594.450455:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323594.450457:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323594.450458:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be7b80. 00000100:00000001:2.0:1767323594.450461:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323594.450463:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.450465:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323594.450474:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323594.450476:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323594.450479:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323594.450481:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323595.015561:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323595.015572:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323595.015578:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323595.015605:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323595.015657:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323595.015660:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323595.015664:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323595.719567:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300812526, at 4300812544 00000100:00000040:1.0:1767323595.719567:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300812526, at 4300812544 00000100:00000010:2.0:1767323595.719589:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49600. 00000100:00000010:1.0:1767323595.719592:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a499c0. 00000100:00000040:0.0:1767323595.719687:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300812526, at 4300812544 00000100:00000010:0.0:1767323595.719695:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49240. 00000100:00000040:3.0:1767323595.719785:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300812526, at 4300812544 00000100:00000010:3.0:1767323595.719791:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49de0. 00010000:00000001:0.0:1767323596.039637:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323596.039647:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323596.039656:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323596.039657:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323596.039769:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323596.039773:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323596.039776:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323597.063528:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323597.063547:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323597.063554:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323597.063556:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323597.063581:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323597.063584:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323597.063587:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323598.087547:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323598.087558:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323598.087561:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323598.087564:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323598.087571:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323598.087573:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323598.087575:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323598.087578:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323598.087583:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323598.087584:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323598.087669:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323598.087673:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323598.087676:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323599.111565:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323599.111575:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323599.111583:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323599.111584:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323599.111618:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323599.111621:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323599.111625:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323599.559642:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323599.559650:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323599.559671:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5f80. 00000020:00000040:0.0:1767323599.559676:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323599.559679:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323599.559681:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323599.559686:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323599.559692:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abb00. 00000100:00000001:0.0:1767323599.559698:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559707:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323599.559715:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323599.559719:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559723:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005239f2cd] to pc [ptlrpcd_00_01+1] req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.559752:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559754:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323599.559757:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323599.559759:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4e00. 00000020:00000040:0.0:1767323599.559760:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323599.559762:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323599.559762:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323599.559764:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323599.559766:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab300. 00000100:00000001:0.0:1767323599.559769:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559773:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323599.559779:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323599.559781:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559785:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000050e78c7b] to pc [ptlrpcd_00_02+2] req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.559810:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559813:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323599.559821:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323599.559824:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5c00. 00000020:00000040:0.0:1767323599.559826:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323599.559828:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323599.559830:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323599.559832:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323599.559835:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abd00. 00000100:00000001:0.0:1767323599.559838:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559842:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323599.559849:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323599.559851:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559866:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007608b19c] to pc [ptlrpcd_00_03+3] req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.559875:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.559878:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323599.559882:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323599.559884:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323599.559888:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323599.559893:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6154) 00000100:00000001:1.0:1767323599.559927:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323599.559932:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323599.559934:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323599.559941:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323599.559949:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323599.559951:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323599.559955:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323599.559957:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323599.559960:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323599.559963:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975843072:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323599.559967:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323599.559984:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323599.559987:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323599.559989:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323599.559993:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410105c3000. 02000000:00000001:1.0:1767323599.559995:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323599.560001:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156e70. 00000400:00000010:1.0:1767323599.560009:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890ad48. 00000100:00000200:1.0:1767323599.560018:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975843072, portal 10 00000100:00000001:1.0:1767323599.560020:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323599.560023:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323599.560023:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470913024 : -118678238638592 : ffff941011be4e00) 00000100:00000001:2.0:1767323599.560029:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323599.560032:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323599.560033:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323599.560042:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323599.560044:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323599.560056:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323599.560061:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890aa18. 00000100:00000001:3.0:1767323599.560065:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000200:1.0:1767323599.560066:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975843072, offset 0 00000100:00000001:2.0:1767323599.560070:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323599.560071:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323599.560074:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1767323599.560074:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 02000000:00000001:2.0:1767323599.560082:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323599.560085:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323599.560089:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323599.560092:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000200:1.0:1767323599.560093:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000100:00100000:2.0:1767323599.560095:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975842944:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323599.560096:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323599.560100:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000400:00000200:1.0:1767323599.560100:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000001:2.0:1767323599.560103:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000400:00000200:1.0:1767323599.560107:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 02000000:00000001:2.0:1767323599.560108:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000100:00000040:3.0:1767323599.560109:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1767323599.560112:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 02000000:00000001:2.0:1767323599.560113:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1767323599.560116:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 02000000:00000001:2.0:1767323599.560119:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:3.0:1767323599.560122:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323599.560125:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323599.560125:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fa00. 02000000:00000001:2.0:1767323599.560131:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323599.560132:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323599.560136:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000400:00000010:2.0:1767323599.560137:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35268. 02000000:00000001:3.0:1767323599.560139:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323599.560144:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975843200:192.168.204.130@tcp:400:kworker.0 00000400:00000010:2.0:1767323599.560144:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3aa0. 00000100:00000200:2.0:1767323599.560150:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975842944, portal 25 00000100:00000001:3.0:1767323599.560151:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000100:00000001:2.0:1767323599.560155:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 02000000:00000001:3.0:1767323599.560156:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000100:00000001:2.0:1767323599.560158:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470917504 : -118678238634112 : ffff941011be5f80) 02000000:00000001:3.0:1767323599.560159:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323599.560164:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000040:2.0:1767323599.560168:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000010:3.0:1767323599.560176:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b4400. 00000100:00000001:2.0:1767323599.560178:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 02000000:00000001:3.0:1767323599.560180:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323599.560185:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323599.560187:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328bb0. 00000400:00000010:2.0:1767323599.560189:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3bb0. 00000100:00000200:2.0:1767323599.560194:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975842944, offset 0 00000400:00000010:3.0:1767323599.560195:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aeca18. 00000100:00000200:3.0:1767323599.560211:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975843200, portal 10 00000100:00000001:3.0:1767323599.560214:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323599.560217:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470916608 : -118678238635008 : ffff941011be5c00) 00000400:00000200:2.0:1767323599.560218:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000040:3.0:1767323599.560229:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323599.560236:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323599.560238:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323599.560241:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecee0. 00000100:00000200:3.0:1767323599.560244:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975843200, offset 0 00000400:00000200:3.0:1767323599.560249:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323599.560760:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1505:1505:256:4294967295] 192.168.204.130@tcp LPNI seq info [1505:1505:8:4294967295] 00000400:00000200:1.0:1767323599.560885:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323599.560899:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323599.560906:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c100. 00000800:00000200:1.0:1767323599.560913:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000400:00000200:2.0:1767323599.560917:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323599.560922:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000800:00000200:1.0:1767323599.560926:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000400:00000200:2.0:1767323599.560930:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000800:00000200:1.0:1767323599.560932:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c100 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:2.0:1767323599.560935:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323599.560939:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323599.560943:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1506:1506:255:4294967295] 192.168.204.130@tcp LPNI seq info [1506:1506:7:4294967295] 00000400:00000200:2.0:1767323599.560953:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:1.0:1767323599.560954:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323599.560959:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12751 usecs (13 jiffies) 00000100:00000001:1.0:1767323599.560964:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300816398 00000100:00000010:1.0:1767323599.560980:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5f60. 00000100:00000001:1.0:1767323599.560987:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:1.0:1767323599.560997:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300816398 00000100:00000010:1.0:1767323599.561000:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5300. 00000100:00000001:1.0:1767323599.561003:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:1.0:1767323599.561006:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300816398 00000400:00000200:3.0:1767323599.561008:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000100:00000010:1.0:1767323599.561010:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5660. 00000400:00000200:3.0:1767323599.561014:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000001:1.0:1767323599.561016:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000400:00000200:3.0:1767323599.561020:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000100:00000001:1.0:1767323599.561021:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300816398 00000400:00000200:3.0:1767323599.561025:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000100:00000010:1.0:1767323599.561027:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5c00. 00000400:00000200:3.0:1767323599.561029:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323599.561033:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1507:1507:254:4294967295] 192.168.204.130@tcp LPNI seq info [1507:1507:6:4294967295] 00000100:00000001:1.0:1767323599.561038:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:1.0:1767323599.561043:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323599.561048:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323599.561051:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:1.0:1767323599.561053:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323599.561058:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000800:00000200:3.0:1767323599.561059:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323599.561066:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3c00. 00000100:00000001:1.0:1767323599.561067:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323599.561070:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323599.561074:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000800:00000200:3.0:1767323599.561075:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000100:00000001:1.0:1767323599.561076:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323599.561079:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323599.561082:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:3.0:1767323599.561086:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323599.561091:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3c00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323599.561095:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323599.561098:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11518 usecs (12 jiffies) 00000100:00000001:3.0:1767323599.561102:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300816397 00000100:00000001:3.0:1767323599.561105:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300816398 00000100:00000001:3.0:1767323599.561115:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300816397 00000100:00000001:3.0:1767323599.561117:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300816398 00000100:00000001:3.0:1767323599.561120:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300816397 00000100:00000001:3.0:1767323599.561122:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300816398 00000100:00000001:3.0:1767323599.561124:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300816397 00000100:00000001:3.0:1767323599.561126:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300816398 00000100:00000001:3.0:1767323599.561128:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323599.561131:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323599.561133:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323599.561135:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323599.561140:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323599.561141:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323599.561143:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323599.561144:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323599.561146:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323599.561148:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1767323599.561184:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323599.561188:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7a00. 00000800:00000200:2.0:1767323599.561192:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323599.561196:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323599.561199:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7a00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323599.561202:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323599.561205:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300817646 00000100:00000001:2.0:1767323599.561210:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300816398 00000100:00000001:2.0:1767323599.561213:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300817646 00000100:00000001:2.0:1767323599.561215:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300816398 00000100:00000001:2.0:1767323599.561218:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300817646 00000100:00000001:2.0:1767323599.561220:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300816398 00000100:00000001:2.0:1767323599.561222:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300817646 00000100:00000001:2.0:1767323599.561225:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300816398 00000100:00000001:2.0:1767323599.561227:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323599.561229:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323599.561232:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323599.561234:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323599.561237:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323599.561238:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323599.561240:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323599.561241:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323599.561242:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323599.561244:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323599.561357:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323599.561364:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c100. 00000400:00000200:0.0:1767323599.561368:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323599.561373:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323599.561379:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890aa18 00000400:00000010:0.0:1767323599.561406:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890aa18. 00000100:00000001:0.0:1767323599.561410:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323599.561417:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.561588:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323599.561593:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.561600:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323599.561602:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323599.561621:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323599.561624:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3c00. 00000400:00000200:0.0:1767323599.561628:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323599.561632:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323599.561635:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecee0 00000400:00000010:0.0:1767323599.561637:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecee0. 00000100:00000001:0.0:1767323599.561640:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323599.561643:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.561651:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323599.561654:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.561660:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323599.561661:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323599.561790:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323599.561793:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7a00. 00000400:00000200:0.0:1767323599.561797:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323599.561802:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323599.561806:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3bb0 00000400:00000010:0.0:1767323599.561808:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3bb0. 00000100:00000001:0.0:1767323599.561811:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323599.561815:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.561821:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323599.561824:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.561841:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323599.561843:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1767323599.567532:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.567774:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323599.567779:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.567781:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323599.567797:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323599.567817:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953ec80 00000400:00000200:3.0:1767323599.567827:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3111 [1] + 224 00000800:00000001:3.0:1767323599.567838:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.567842:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323599.567845:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323599.567850:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323599.567859:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323599.567869:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323599.567880:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323599.567921:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323599.567931:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.567935:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323599.567937:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.567939:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323599.567943:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323599.567950:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ed00 00000400:00000200:3.0:1767323599.567956:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3109 [1] + 224 00000800:00000001:3.0:1767323599.567960:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.567963:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323599.567965:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323599.567979:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323599.567982:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323599.567987:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323599.567996:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323599.568012:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323599.568016:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.568020:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323599.568022:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.568024:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323599.568028:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323599.568034:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ed80 00000400:00000200:3.0:1767323599.568040:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3119 [1] + 224 00000800:00000001:3.0:1767323599.568044:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323599.568050:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323599.568052:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323599.568056:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323599.568058:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323599.568059:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000001:1.0:1767323599.568063:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323599.568069:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000100:00000200:3.0:1767323599.568071:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000001:1.0:1767323599.568072:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323599.568076:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156e70. 00000400:00000200:1.0:1767323599.568081:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890ad48 00000400:00000010:1.0:1767323599.568085:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890ad48. 00000100:00000040:3.0:1767323599.568087:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323599.568088:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323599.568095:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323599.568111:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323599.568116:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323599.568118:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323599.568123:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323599.568130:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000100:00000001:1.0:1767323599.568130:0:111003:0:(client.c:1578:after_reply()) Process entered 00000800:00000001:3.0:1767323599.568137:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:1.0:1767323599.568137:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323599.568141:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323599.568146:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323599.568151:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323599.568164:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=51 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323599.568169:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=51 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323599.568171:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323599.568172:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323599.568174:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323599.568175:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323599.568178:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00000400:00000001:0.0:1767323599.568179:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323599.568180:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00010000:00000001:1.0:1767323599.568183:0:111003:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323599.568183:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328bb0. 00000400:00000200:0.0:1767323599.568187:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aeca18 00000400:00000010:0.0:1767323599.568188:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aeca18. 00000100:00000001:0.0:1767323599.568191:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000001:1.0:1767323599.568195:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000200:0.0:1767323599.568196:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323599.568198:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323599.568200:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323599.568201:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323599.568206:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323599.568215:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323599.568218:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323599.568221:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323599.568225:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323599.568232:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:1.0:1767323599.568233:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975843072:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323599.568238:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323599.568242:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000400:00000001:2.0:1767323599.568243:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000100:00000001:1.0:1767323599.568247:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000400:00000001:2.0:1767323599.568248:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323599.568252:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35268. 00000100:00000040:1.0:1767323599.568253:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4e00 x1853171975843072/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1767323599.568258:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3aa0 00000400:00000010:2.0:1767323599.568262:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3aa0. 00000100:00000001:2.0:1767323599.568266:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000001:1.0:1767323599.568277:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 00000100:00000200:2.0:1767323599.568280:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:1.0:1767323599.568282:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323599.568287:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410105c3000. 02000000:00000001:1.0:1767323599.568294:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000100:00000200:2.0:1767323599.568296:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000001:1.0:1767323599.568299:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323599.568303:0:111003:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:1.0:1767323599.568308:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 00000100:00000001:2.0:1767323599.568312:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 02000000:00000010:1.0:1767323599.568312:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab300. 00000100:00000001:2.0:1767323599.568315:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:0.0:1767323599.568317:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000001:1.0:1767323599.568318:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 00000100:00000001:2.0:1767323599.568319:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323599.568321:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 02000000:00000001:2.0:1767323599.568322:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000010:1.0:1767323599.568324:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4e00. 00000100:00000001:2.0:1767323599.568326:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323599.568328:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323599.568329:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323599.568329:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323599.568331:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323599.568331:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:2.0:1767323599.568334:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323599.568335:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323599.568335:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323599.568337:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323599.568339:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323599.568340:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323599.568341:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=52 v=5 (5 0 0 0) 02000000:00000001:0.0:1767323599.568343:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323599.568345:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00001000:2.0:1767323599.568349:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=52 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323599.568349:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323599.568351:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=51 v=5 (5 0 0 0) 00000100:00000001:2.0:1767323599.568353:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323599.568357:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323599.568358:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00001000:0.0:1767323599.568358:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=51 v=5 (1 0 0 0) 00010000:00000001:2.0:1767323599.568361:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00000100:00000001:0.0:1767323599.568361:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323599.568362:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323599.568365:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323599.568366:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323599.568367:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00000100:00000001:2.0:1767323599.568371:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00010000:00080000:0.0:1767323599.568374:0:111004:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323599.568381:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1767323599.568421:0:111004:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323599.568423:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323599.568425:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000001:2.0:1767323599.568427:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000040:0.0:1767323599.568428:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323599.568430:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323599.568435:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323599.568442:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975842944:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323599.568446:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323599.568448:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323599.568451:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5f80 x1853171975842944/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323599.568457:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323599.568463:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323599.568465:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fa00. 02000000:00000001:2.0:1767323599.568468:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323599.568470:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323599.568471:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:2.0:1767323599.568472:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323599.568474:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abb00. 02000000:00000001:2.0:1767323599.568477:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323599.568478:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323599.568480:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5f80. 00000100:00000001:2.0:1767323599.568483:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323599.568484:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323599.568486:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323599.568490:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323599.568491:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323599.568493:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323599.568495:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323599.568589:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323599.568590:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323599.568599:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.568604:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323599.568606:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323599.568607:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323599.568609:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323599.568613:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975843200:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323599.568616:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323599.568617:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323599.568619:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5c00 x1853171975843200/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323615 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323599.568622:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323599.568624:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323599.568625:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b4400. 02000000:00000001:0.0:1767323599.568627:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323599.568628:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323599.568628:0:111004:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323599.568630:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323599.568631:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abd00. 02000000:00000001:0.0:1767323599.568633:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323599.568633:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323599.568634:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5c00. 00000100:00000001:0.0:1767323599.568636:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323599.568637:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323599.568638:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323599.568641:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323599.568642:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323599.568643:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323599.568644:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323600.136705:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323600.136712:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323600.136717:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323600.136738:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323600.136740:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323600.136744:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323600.136746:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323600.136747:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323600.136749:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323600.136751:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323600.136752:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323600.136754:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323600.136792:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323600.136796:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323600.136798:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323600.839503:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300817646, at 4300817664 00000100:00000040:1.0:1767323600.839503:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300817646, at 4300817664 00000100:00000040:0.0:1767323600.839504:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300817646, at 4300817664 00000100:00000010:1.0:1767323600.839520:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5300. 00000100:00000010:0.0:1767323600.839522:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5f60. 00000100:00000010:2.0:1767323600.839523:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5660. 00000100:00000040:3.0:1767323600.839615:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300817646, at 4300817664 00000100:00000010:3.0:1767323600.839621:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5c00. 00010000:00000001:0.0:1767323601.159526:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323601.159534:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323601.159540:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323601.159542:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323601.159569:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323601.159581:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323601.159584:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323602.183840:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323602.183847:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323602.183853:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323602.183855:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323602.184578:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323602.184581:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323602.184585:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323603.207567:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323603.207574:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323603.207580:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323603.207582:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323603.207623:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323603.207626:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323603.207629:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323604.231501:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323604.231510:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323604.231527:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323604.231529:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323604.232533:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323604.232538:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323604.232543:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323604.679754:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323604.679765:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323604.679777:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f11180. 00000020:00000040:2.0:1767323604.679784:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:2.0:1767323604.679789:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1767323604.679793:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1767323604.679798:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323604.679808:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7400. 00000100:00000001:2.0:1767323604.679816:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323604.679827:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1767323604.679838:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1767323604.679842:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323604.679868:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ac42371] to pc [ptlrpcd_00_00+0] req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323604.679916:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323604.679919:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323604.679923:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323604.679926:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f11500. 00000020:00000040:2.0:1767323604.679929:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:2.0:1767323604.679931:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1767323604.679933:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1767323604.679935:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323604.679940:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7a00. 00000100:00000001:2.0:1767323604.679943:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323604.679948:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323604.679950:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323604.679955:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323604.679958:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323604.679959:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000001:2.0:1767323604.679963:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323604.679970:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323604.679971:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f1ef9604] to pc [ptlrpcd_00_01+1] req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323604.679992:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323604.679995:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323604.679996:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323604.680000:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323604.680003:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323604.680006:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f12d80. 00000020:00000040:2.0:1767323604.680008:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:2.0:1767323604.680011:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323604.680012:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323604.680013:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323604.680016:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323604.680017:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323604.680023:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323604.680025:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7700. 00000100:00000001:2.0:1767323604.680030:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323604.680031:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975843328:192.168.204.130@tcp:400:kworker.0 00000100:00000040:2.0:1767323604.680038:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323604.680039:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323604.680047:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323604.680050:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323604.680053:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323604.680059:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5200. 02000000:00000001:3.0:1767323604.680062:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323604.680072:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328b58. 00000100:00000001:2.0:1767323604.680074:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1767323604.680079:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323604.680083:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec110. 00000100:00000040:2.0:1767323604.680085:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c5d0fd2a] to pc [ptlrpcd_00_02+2] req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323604.680091:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975843328, portal 25 00000100:00000001:3.0:1767323604.680096:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323604.680098:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145328512 : -118677564223104 : ffff941039f11180) 00000100:00000040:3.0:1767323604.680105:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323604.680115:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323604.680120:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323604.680122:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323604.680127:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1767323604.680128:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323604.680134:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec330. 00000100:00000040:2.0:1767323604.680134:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000200:3.0:1767323604.680141:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975843328, offset 0 00000100:00000040:2.0:1767323604.680141:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:2.0:1767323604.680150:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6159) 00000400:00000200:3.0:1767323604.680152:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323604.680170:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323604.680176:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323604.680183:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323604.680187:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323604.680190:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323604.680194:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1508:1508:256:4294967295] 192.168.204.130@tcp LPNI seq info [1508:1508:8:4294967295] 00000100:00000001:1.0:1767323604.680196:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323604.680199:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323604.680201:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000400:00000200:3.0:1767323604.680206:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000040:1.0:1767323604.680207:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000200:3.0:1767323604.680213:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000100:00000001:1.0:1767323604.680214:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323604.680216:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000800:00000010:3.0:1767323604.680218:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3000. 02000000:00000001:1.0:1767323604.680218:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323604.680220:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323604.680222:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323604.680224:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975843584:192.168.204.130@tcp:400:kworker.0 00000800:00000200:3.0:1767323604.680225:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000100:00000001:1.0:1767323604.680228:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323604.680230:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323604.680232:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:3.0:1767323604.680234:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 02000000:00000001:1.0:1767323604.680234:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323604.680237:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010710e00. 00000800:00000200:3.0:1767323604.680239:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3000 type 1, nob 320 niov 1 nkiov 1 02000000:00000001:1.0:1767323604.680239:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323604.680244:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156e70. 00000400:00000010:1.0:1767323604.680248:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890ad48. 00000100:00000200:1.0:1767323604.680251:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975843584, portal 10 00000100:00000001:1.0:1767323604.680253:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323604.680254:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145335680 : -118677564215936 : ffff941039f12d80) 00000100:00000001:3.0:1767323604.680261:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323604.680261:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323604.680265:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300822765 00000100:00000010:3.0:1767323604.680269:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9410399077e0. 00000100:00000001:3.0:1767323604.680276:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1767323604.680277:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323604.680279:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323604.680282:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a198. 00000100:00000001:3.0:1767323604.680283:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300822765 00000100:00000010:3.0:1767323604.680285:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9410399072a0. 00000100:00000200:1.0:1767323604.680285:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975843584, offset 0 00000100:00000001:3.0:1767323604.680289:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000400:00000200:1.0:1767323604.680289:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:3.0:1767323604.680292:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300822765 00000400:00000200:1.0:1767323604.680294:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000100:00000010:3.0:1767323604.680295:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907180. 00000400:00000200:1.0:1767323604.680297:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000001:3.0:1767323604.680299:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000400:00000200:1.0:1767323604.680300:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000100:00000001:3.0:1767323604.680301:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300822765 00000400:00000200:1.0:1767323604.680302:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000100:00000010:3.0:1767323604.680304:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907480. 00000400:00000200:1.0:1767323604.680304:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323604.680307:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1509:1509:255:4294967295] 192.168.204.130@tcp LPNI seq info [1509:1509:7:4294967295] 00000100:00000001:3.0:1767323604.680310:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:3.0:1767323604.680314:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000400:00000200:1.0:1767323604.680315:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:3.0:1767323604.680317:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323604.680319:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000100:00000001:3.0:1767323604.680320:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000800:00000010:1.0:1767323604.680322:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4cb00. 00000100:00000001:3.0:1767323604.680323:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000800:00000200:1.0:1767323604.680326:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323604.680330:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000100:00000001:3.0:1767323604.680331:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000800:00000200:1.0:1767323604.680332:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4cb00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323604.680333:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323604.680335:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323604.680336:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323604.680337:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323604.680338:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323604.680339:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11446 usecs (12 jiffies) 00000100:00100000:3.0:1767323604.680341:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000001:1.0:1767323604.680341:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300821516 00000100:00000001:3.0:1767323604.680343:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323604.680344:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300822765 00000100:00000001:3.0:1767323604.680345:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323604.680346:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323604.680346:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300821516 00000100:00000001:3.0:1767323604.680348:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323604.680348:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300822765 00000100:00000001:3.0:1767323604.680349:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323604.680350:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000001:1.0:1767323604.680350:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300821516 00000100:00000001:1.0:1767323604.680352:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300822765 00000100:00000040:3.0:1767323604.680354:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323604.680354:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300821516 00000100:00000001:1.0:1767323604.680356:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300822765 00000100:00000001:3.0:1767323604.680361:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323604.680362:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323604.680362:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323604.680364:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:1.0:1767323604.680364:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323604.680366:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323604.680366:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323604.680367:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 02000000:00000001:3.0:1767323604.680368:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323604.680371:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975843456:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323604.680371:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323604.680372:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323604.680375:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000100:00000001:1.0:1767323604.680375:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323604.680376:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 02000000:00000001:3.0:1767323604.680377:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000100:00000001:1.0:1767323604.680378:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323604.680379:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323604.680380:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:1.0:1767323604.680380:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323604.680402:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323604.680405:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323604.680411:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323604.680413:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323604.680420:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b4a00. 02000000:00000001:3.0:1767323604.680424:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323604.680428:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410013284d0. 00000400:00000010:3.0:1767323604.680431:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec6e8. 00000100:00000200:3.0:1767323604.680434:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975843456, portal 10 00000100:00000001:3.0:1767323604.680436:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323604.680442:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145329408 : -118677564222208 : ffff941039f11500) 00000100:00000040:3.0:1767323604.680448:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323604.680455:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323604.680457:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323604.680460:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec5d8. 00000100:00000200:3.0:1767323604.680462:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975843456, offset 0 00000400:00000200:3.0:1767323604.680466:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323604.680471:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323604.680474:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323604.680476:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323604.680478:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323604.680481:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323604.680483:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1510:1510:254:4294967295] 192.168.204.130@tcp LPNI seq info [1510:1510:6:4294967295] 00000400:00000200:3.0:1767323604.680490:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323604.680495:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323604.680499:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3400. 00000800:00000200:3.0:1767323604.680502:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323604.680506:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323604.680509:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3400 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323604.680512:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323604.680515:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12621 usecs (13 jiffies) 00000100:00000001:3.0:1767323604.680518:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300821518 00000100:00000001:3.0:1767323604.680520:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300822765 00000100:00000001:3.0:1767323604.680521:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300821518 00000100:00000001:3.0:1767323604.680523:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300822765 00000100:00000001:3.0:1767323604.680526:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300821518 00000100:00000001:3.0:1767323604.680528:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300822765 00000100:00000001:3.0:1767323604.680530:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300821518 00000100:00000001:3.0:1767323604.680538:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300822765 00000100:00000001:3.0:1767323604.680540:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323604.680542:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323604.680544:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323604.680546:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1767323604.680760:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323604.680764:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3000. 00000400:00000200:2.0:1767323604.680772:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323604.680778:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323604.680783:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec330 00000400:00000010:2.0:1767323604.680786:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec330. 00000100:00000001:2.0:1767323604.680791:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323604.680796:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323604.680805:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323604.680809:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323604.680815:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323604.680817:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1767323604.680828:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323604.680830:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4cb00. 00000400:00000200:2.0:1767323604.680833:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323604.680836:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323604.680845:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a198 00000400:00000010:2.0:1767323604.680847:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a198. 00000100:00000001:2.0:1767323604.680849:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323604.680854:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323604.680862:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323604.680865:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323604.680872:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323604.680883:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1767323604.680955:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323604.680958:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3400. 00000400:00000200:2.0:1767323604.680961:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323604.680965:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323604.680968:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec5d8 00000400:00000010:2.0:1767323604.680969:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec5d8. 00000100:00000001:2.0:1767323604.680971:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323604.680974:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323604.680981:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323604.680984:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323604.680990:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323604.680991:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:0.0:1767323604.690523:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690567:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323604.690572:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690574:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323604.690587:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323604.690607:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ef00 00000400:00000200:0.0:1767323604.690615:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3129 [1] + 224 00000800:00000001:0.0:1767323604.690624:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690628:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323604.690631:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323604.690636:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323604.690643:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323604.690652:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323604.690664:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323604.690694:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323604.690707:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690711:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323604.690713:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690715:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323604.690718:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323604.690724:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953ee00 00000400:00000200:0.0:1767323604.690729:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3121 [1] + 224 00000800:00000001:0.0:1767323604.690732:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690736:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323604.690738:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323604.690740:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323604.690744:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323604.690748:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323604.690756:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323604.690776:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323604.690781:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690785:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323604.690787:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690789:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323604.690794:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323604.690799:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ee80 00000400:00000200:0.0:1767323604.690804:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3131 [1] + 224 00000800:00000001:0.0:1767323604.690807:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690819:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323604.690821:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323604.690824:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323604.690827:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323604.690831:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323604.690840:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323604.690847:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323604.690850:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323604.690853:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323604.690913:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323604.690919:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323604.690926:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323604.690928:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323604.690932:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156e70. 00000400:00000200:1.0:1767323604.690936:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890ad48 00000400:00000010:1.0:1767323604.690938:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890ad48. 00000100:00000001:1.0:1767323604.690941:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323604.690947:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323604.690956:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323604.690964:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323604.690967:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323604.690969:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323604.690972:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323604.690975:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323604.690977:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323604.690980:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323604.690989:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=56 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323604.690994:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=56 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323604.690996:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323604.690998:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323604.691002:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:1.0:1767323604.691009:0:111003:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1767323604.691029:0:111003:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323604.691032:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323604.691035:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000001:3.0:1767323604.691040:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000040:1.0:1767323604.691041:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323604.691047:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323604.691049:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:3.0:1767323604.691052:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323604.691057:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000100:00000040:1.0:1767323604.691059:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:3.0:1767323604.691064:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410013284d0. 00000400:00000200:3.0:1767323604.691072:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec6e8 00000100:00000001:1.0:1767323604.691074:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000400:00000010:3.0:1767323604.691080:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec6e8. 00000100:00000001:1.0:1767323604.691083:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323604.691087:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000001:1.0:1767323604.691088:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:3.0:1767323604.691105:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323604.691105:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323604.691155:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323604.691157:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975843584:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323604.691186:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323604.691186:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323604.691191:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323604.691194:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000001:3.0:1767323604.691196:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323604.691203:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323604.691206:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000040:1.0:1767323604.691207:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f12d80 x1853171975843584/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323604.691211:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323604.691218:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323604.691231:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 00000100:00001000:3.0:1767323604.691232:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=56 v=5 (5 0 0 0) 02000000:00000001:1.0:1767323604.691237:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 00000100:00001000:3.0:1767323604.691239:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=56 v=5 (1 0 0 0) 02000000:00000010:1.0:1767323604.691243:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010710e00. 00000100:00000001:3.0:1767323604.691244:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323604.691248:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323604.691254:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 02000000:00000001:1.0:1767323604.691254:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00010000:00000001:3.0:1767323604.691263:0:111001:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323604.691264:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000100:00000001:3.0:1767323604.691267:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000020:00000040:1.0:1767323604.691270:0:111003:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000040:3.0:1767323604.691271:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323604.691276:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323604.691280:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323604.691284:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 00000100:00000040:3.0:1767323604.691291:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 02000000:00000010:1.0:1767323604.691292:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7700. 02000000:00000001:1.0:1767323604.691299:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323604.691302:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323604.691304:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f12d80. 00000100:00000001:1.0:1767323604.691313:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323604.691316:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323604.691334:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323604.691340:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323604.691345:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323604.691348:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323604.691349:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323604.691356:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323604.691362:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323604.691363:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323604.691369:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323604.691426:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975843456:192.168.204.130@tcp:400:kworker.0 00000400:00000001:3.0:1767323604.691436:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323604.691438:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323604.691440:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328b58. 00000400:00000200:3.0:1767323604.691443:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec110 00000400:00000010:3.0:1767323604.691445:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec110. 00000100:00000001:3.0:1767323604.691447:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323604.691451:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323604.691460:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323604.691467:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323604.691469:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323604.691471:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323604.691472:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323604.691474:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323604.691475:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323604.691477:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323604.691481:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=57 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323604.691484:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=57 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323604.691486:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323604.691487:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323604.691489:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323604.691491:0:111001:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323604.691493:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323604.691497:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323604.691510:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323604.691513:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323604.691514:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323604.691790:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323604.691798:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975843328:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323604.691803:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323604.691805:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323604.691808:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f11500 x1853171975843456/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323604.691815:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323604.691817:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323604.691820:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b4a00. 02000000:00000001:3.0:1767323604.691824:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323604.691827:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323604.691829:0:111001:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323604.691832:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323604.691834:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7a00. 02000000:00000001:3.0:1767323604.691839:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323604.691840:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323604.691842:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f11500. 00000100:00000001:3.0:1767323604.691846:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323604.691847:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323604.691849:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323604.691853:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f11180 x1853171975843328/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323620 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323604.691859:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323604.691860:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323604.691861:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5200. 02000000:00000001:3.0:1767323604.691863:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323604.691864:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323604.691872:0:111001:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:3.0:1767323604.691883:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323604.691885:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7400. 02000000:00000001:3.0:1767323604.691888:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323604.691889:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323604.691890:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f11180. 00000100:00000001:3.0:1767323604.691893:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323604.691894:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323604.691896:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323604.691904:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323604.691905:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323604.691908:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323604.691911:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323605.255856:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323605.255873:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323605.255879:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323605.255883:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323605.255905:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323605.255908:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323605.255911:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323605.959548:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300822765, at 4300822784 00000100:00000010:0.0:1767323605.959570:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9410399077e0. 00000100:00000040:1.0:1767323605.959664:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300822765, at 4300822784 00000100:00000010:1.0:1767323605.959671:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9410399072a0. 00000100:00000040:3.0:1767323605.959745:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300822765, at 4300822784 00000100:00000010:3.0:1767323605.959752:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907480. 00000100:00000040:2.0:1767323605.959824:0:118030:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300822765, at 4300822784 00000100:00000010:2.0:1767323605.959830:0:118030:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907180. 00010000:00000001:0.0:1767323606.279600:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323606.279606:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323606.279628:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323606.279629:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323606.280208:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323606.280224:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323606.280228:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323607.303760:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323607.303770:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323607.303777:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323607.303778:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1767323607.303812:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1767323607.303815:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1767323607.303819:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323608.331098:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323608.331106:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323608.331108:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323608.331111:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323608.331116:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323608.331118:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323608.331119:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323608.331121:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323608.331124:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323608.331125:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323608.332277:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323608.332281:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323608.332285:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323609.351903:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323609.351911:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323609.351916:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323609.351917:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323609.351979:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323609.351982:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323609.351985:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323609.799632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323609.799645:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323609.799658:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5c00. 00000020:00000040:0.0:1767323609.799665:0:8:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323609.799669:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323609.799672:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323609.799679:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323609.799688:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abd00. 00000100:00000001:0.0:1767323609.799695:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799709:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323609.799720:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323609.799744:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799750:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007608b19c] to pc [ptlrpcd_00_03+3] req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.799790:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799792:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323609.799795:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323609.799798:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6d80. 00000020:00000040:0.0:1767323609.799799:0:8:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323609.799801:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323609.799802:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323609.799804:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323609.799807:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab400. 00000100:00000001:0.0:1767323609.799809:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799812:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323609.799817:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323609.799819:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799821:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008fd8fbd1] to pc [ptlrpcd_00_00+0] req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.799837:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799838:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323609.799840:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323609.799842:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5880. 00000020:00000040:0.0:1767323609.799843:0:8:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323609.799845:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323609.799845:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323609.799846:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323609.799848:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abe00. 00000100:00000001:0.0:1767323609.799850:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799853:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323609.799865:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323609.799867:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799869:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003879b242] to pc [ptlrpcd_00_01+1] req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.799875:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.799876:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323609.799879:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323609.799881:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323609.799883:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323609.799887:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6164) 00000100:00000001:0.0:1767323609.799961:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323609.799964:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323609.799966:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323609.799970:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.799975:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323609.799977:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323609.799981:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323609.799983:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323609.799986:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323609.799988:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975843968:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323609.799991:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323609.799997:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323609.800000:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323609.800002:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323609.800007:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102030f800. 02000000:00000001:0.0:1767323609.800009:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323609.800015:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107164d0. 00000400:00000010:0.0:1767323609.800027:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089976e8. 00000100:00000200:0.0:1767323609.800035:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975843968, portal 10 00000100:00000001:0.0:1767323609.800037:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323609.800038:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470915712 : -118678238635904 : ffff941011be5880) 00000100:00000040:0.0:1767323609.800044:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.800050:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323609.800052:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323609.800054:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997cc0. 00000100:00000200:0.0:1767323609.800057:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975843968, offset 0 00000400:00000200:0.0:1767323609.800062:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323609.800076:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323609.800081:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323609.800085:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323609.800089:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323609.800091:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323609.800102:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1511:1511:256:4294967295] 192.168.204.130@tcp LPNI seq info [1511:1511:8:4294967295] 00000400:00000200:0.0:1767323609.800118:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323609.800126:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323609.800134:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012abb00. 00000800:00000200:0.0:1767323609.800142:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323609.800153:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323609.800163:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012abb00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323609.800179:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.800184:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11598 usecs (12 jiffies) 00000100:00000001:0.0:1767323609.800189:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300826636 00000100:00000010:0.0:1767323609.800194:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2b40. 00000100:00000001:0.0:1767323609.800202:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:0.0:1767323609.800209:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300826636 00000100:00000010:0.0:1767323609.800212:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba22a0. 00000100:00000001:0.0:1767323609.800235:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:0.0:1767323609.800244:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300826636 00000100:00000010:0.0:1767323609.800247:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2900. 00000100:00000001:0.0:1767323609.800251:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:0.0:1767323609.800256:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300826636 00000100:00000010:0.0:1767323609.800259:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2e40. 00000100:00000001:0.0:1767323609.800262:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:0.0:1767323609.800268:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323609.800271:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323609.800274:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323609.800277:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323609.800287:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323609.800290:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323609.800292:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323609.800293:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323609.800295:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323609.800298:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000001:0.0:1767323609.800300:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323609.800302:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323609.800303:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323609.800304:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323609.800305:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323609.800307:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323609.800311:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.800319:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323609.800320:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323609.800323:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323609.800324:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323609.800326:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323609.800329:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975843840:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323609.800332:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323609.800335:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323609.800340:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323609.800342:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323609.800344:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102030ee00. 02000000:00000001:0.0:1767323609.800345:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323609.800348:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410107165d8. 00000400:00000010:0.0:1767323609.800351:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997330. 00000100:00000200:0.0:1767323609.800353:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975843840, portal 10 00000100:00000001:0.0:1767323609.800354:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323609.800355:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470921088 : -118678238630528 : ffff941011be6d80) 00000100:00000040:0.0:1767323609.800360:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.800365:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323609.800366:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323609.800368:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997880. 00000100:00000200:0.0:1767323609.800370:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975843840, offset 0 00000400:00000200:0.0:1767323609.800373:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323609.800377:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323609.800378:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323609.800380:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323609.800403:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323609.800405:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323609.800407:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1512:1512:255:4294967295] 192.168.204.130@tcp LPNI seq info [1512:1512:7:4294967295] 00000400:00000200:0.0:1767323609.800412:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323609.800415:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323609.800418:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab300. 00000800:00000200:0.0:1767323609.800421:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323609.800426:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323609.800428:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab300 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323609.800431:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323609.800434:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12695 usecs (13 jiffies) 00000100:00000001:0.0:1767323609.800437:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300826638 00000100:00000001:0.0:1767323609.800447:0:111002:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, simply extend its deadline from 4300826636 00000100:00000001:0.0:1767323609.800450:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300826638 00000100:00000001:0.0:1767323609.800453:0:111002:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, simply extend its deadline from 4300826636 00000100:00000001:0.0:1767323609.800455:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300826638 00000100:00000001:0.0:1767323609.800458:0:111002:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, simply extend its deadline from 4300826636 00000100:00000001:0.0:1767323609.800460:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300826638 00000100:00000001:0.0:1767323609.800462:0:111002:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, simply extend its deadline from 4300826636 00000100:00000001:0.0:1767323609.800465:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323609.800467:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323609.800470:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323609.800472:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323609.800527:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323609.800530:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012abb00. 00000400:00000200:0.0:1767323609.800537:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323609.800542:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323609.800547:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997cc0 00000400:00000010:0.0:1767323609.800549:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997cc0. 00000100:00000001:0.0:1767323609.800553:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323609.800557:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.800564:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323609.800567:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.800572:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323609.800573:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323609.800646:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323609.800648:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab300. 00000400:00000200:0.0:1767323609.800650:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323609.800653:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323609.800654:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997880 00000400:00000010:0.0:1767323609.800659:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997880. 00000100:00000001:0.0:1767323609.800661:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323609.800664:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.800669:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323609.800671:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.800675:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323609.800676:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:1.0:1767323609.800744:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323609.800747:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323609.800748:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323609.800753:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323609.800758:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323609.800759:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323609.800761:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323609.800762:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323609.800764:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323609.800765:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975843712:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323609.800768:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323609.800770:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323609.800771:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323609.800772:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323609.800775:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010710e00. 02000000:00000001:1.0:1767323609.800777:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323609.800793:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156e70. 00000400:00000010:1.0:1767323609.800799:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890ad48. 00000100:00000200:1.0:1767323609.800802:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975843712, portal 25 00000100:00000001:1.0:1767323609.800805:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323609.800811:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470916608 : -118678238635008 : ffff941011be5c00) 00000100:00000040:1.0:1767323609.800821:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323609.800827:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323609.800830:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323609.800832:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890add0. 00000100:00000200:1.0:1767323609.800835:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975843712, offset 0 00000400:00000200:1.0:1767323609.800840:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323609.800846:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323609.800849:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323609.800851:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323609.800853:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323609.800855:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323609.800858:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1513:1513:256:4294967295] 192.168.204.130@tcp LPNI seq info [1513:1513:8:4294967295] 00000400:00000200:1.0:1767323609.800865:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323609.800869:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323609.800874:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c000. 00000800:00000200:1.0:1767323609.800877:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323609.800882:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323609.800884:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c000 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323609.800902:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323609.800905:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300827886 00000100:00000001:1.0:1767323609.800909:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300826638 00000100:00000001:1.0:1767323609.800913:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300827886 00000100:00000001:1.0:1767323609.800915:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300826638 00000100:00000001:1.0:1767323609.800918:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300827886 00000100:00000001:1.0:1767323609.800920:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300826638 00000100:00000001:3.0:1767323609.800921:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323609.800923:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300827886 00000100:00000001:3.0:1767323609.800924:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323609.800925:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300826638 00000100:00000001:1.0:1767323609.800933:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323609.800935:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323609.800937:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323609.800939:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323609.800943:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323609.800945:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323609.800947:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323609.800948:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323609.800949:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323609.800951:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323609.801011:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323609.801015:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323609.801491:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323609.801495:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c000. 00000400:00000200:0.0:1767323609.801500:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323609.801505:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323609.801510:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890add0 00000400:00000010:0.0:1767323609.801511:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890add0. 00000100:00000001:0.0:1767323609.801515:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323609.801520:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.801529:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323609.801532:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.801539:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323609.801541:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:0.0:1767323609.804689:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804712:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323609.804716:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804718:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323609.804732:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323609.804753:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f000 00000400:00000200:0.0:1767323609.804762:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3141 [1] + 224 00000800:00000001:0.0:1767323609.804770:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804774:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323609.804804:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323609.804809:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323609.804816:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323609.804826:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323609.804835:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323609.804879:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323609.804883:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323609.804897:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323609.804906:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804909:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323609.804910:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804911:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323609.804914:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323609.804918:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953ef80 00000400:00000200:0.0:1767323609.804924:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3149 [1] + 224 00000800:00000001:0.0:1767323609.804927:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804929:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323609.804930:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323609.804932:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323609.804934:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323609.804938:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323609.804943:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.804957:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323609.804959:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804961:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323609.804962:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804964:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323609.804966:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323609.804969:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f080 00000400:00000200:0.0:1767323609.804977:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3139 [1] + 224 00000800:00000001:0.0:1767323609.804980:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.804984:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323609.804985:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323609.804987:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323609.804989:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323609.804993:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323609.804998:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323609.805003:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323609.805005:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323609.805007:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323609.805124:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323609.805128:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323609.805135:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323609.805138:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323609.805142:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156e70. 00000400:00000200:1.0:1767323609.805147:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890ad48 00000400:00000010:1.0:1767323609.805149:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890ad48. 00000100:00000001:1.0:1767323609.805153:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323609.805158:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323609.805167:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323609.805174:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323609.805176:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323609.805178:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323609.805181:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323609.805184:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323609.805186:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323609.805188:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323609.805196:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=62 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323609.805199:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=62 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323609.805201:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323609.805203:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323609.805205:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323609.805207:0:111004:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323609.805209:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323609.805218:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323609.805233:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323609.805236:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323609.805238:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323609.805241:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323609.805247:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975843712:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323609.805250:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323609.805252:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323609.805255:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5c00 x1853171975843712/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323609.805260:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323609.805263:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323609.805266:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010710e00. 02000000:00000001:1.0:1767323609.805269:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323609.805271:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323609.805273:0:111004:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:1.0:1767323609.805275:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323609.805277:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abd00. 02000000:00000001:1.0:1767323609.805281:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323609.805283:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323609.805285:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5c00. 00000100:00000001:1.0:1767323609.805288:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323609.805289:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323609.805291:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323609.805299:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323609.805301:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323609.805304:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323609.805306:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:2.0:1767323609.805474:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323609.805477:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323609.805479:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107165d8. 00000400:00000200:2.0:1767323609.805489:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997330 00000400:00000010:2.0:1767323609.805491:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997330. 00000100:00000001:2.0:1767323609.805495:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323609.805499:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323609.805508:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323609.805512:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323609.805514:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323609.805515:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323609.805516:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323609.805517:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323609.805518:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323609.805520:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323609.805526:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=61 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323609.805528:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=61 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323609.805529:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323609.805530:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323609.805532:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323609.805534:0:111002:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323609.805537:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323609.805539:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323609.805541:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323609.805542:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323609.805544:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323609.805548:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323609.805549:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323609.805550:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323609.805552:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323609.805556:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975843840:192.168.204.130@tcp:400:kworker.0 00000400:00000001:2.0:1767323609.805566:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323609.805567:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323609.805568:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410107164d0. 00000400:00000200:2.0:1767323609.805570:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089976e8 00000400:00000010:2.0:1767323609.805572:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089976e8. 00000100:00000001:2.0:1767323609.805573:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323609.805575:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323609.805580:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323609.805584:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323609.805584:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323609.805585:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323609.805586:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323609.805587:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323609.805587:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323609.805588:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323609.805592:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=61 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323609.805594:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=61 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323609.805595:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323609.805596:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323609.805597:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323609.805600:0:111002:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323609.805604:0:111002:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323609.805605:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323609.805605:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323609.805606:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323609.805607:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323609.805609:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323609.805612:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323609.805616:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323609.805617:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323609.805620:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323609.805625:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975843968:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323609.805627:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323609.805628:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323609.805630:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be6d80 x1853171975843840/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323609.805633:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323609.805634:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323609.805635:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102030ee00. 02000000:00000001:2.0:1767323609.805637:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323609.805638:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323609.805639:0:111002:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323609.805640:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323609.805641:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab400. 02000000:00000001:2.0:1767323609.805642:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323609.805643:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323609.805644:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6d80. 00000100:00000001:2.0:1767323609.805646:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323609.805647:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323609.805648:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323609.805650:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5880 x1853171975843968/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323625 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323609.805654:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323609.805654:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323609.805655:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102030f800. 02000000:00000001:2.0:1767323609.805656:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323609.805657:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323609.805658:0:111002:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323609.805659:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323609.805659:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abe00. 02000000:00000001:2.0:1767323609.805663:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323609.805664:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323609.805665:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5880. 00000100:00000001:2.0:1767323609.805667:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323609.805668:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323609.805669:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323609.805672:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323609.805673:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323609.805674:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323609.805676:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323610.378165:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323610.378176:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323610.378184:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323610.378189:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323610.378191:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323610.378198:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323610.378201:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323610.378203:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323610.378207:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323610.378209:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323610.378211:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323610.378214:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323610.378438:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323610.378525:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323610.378528:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323611.079461:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300827886, at 4300827904 00000100:00000010:3.0:1767323611.079475:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2e40. 00000100:00000040:0.0:1767323611.079903:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300827886, at 4300827904 00000100:00000010:0.0:1767323611.079910:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2b40. 00000100:00000040:1.0:1767323611.082041:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300827886, at 4300827906 00000100:00000010:1.0:1767323611.082055:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba22a0. 00000100:00000040:2.0:1767323611.082333:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300827886, at 4300827906 00000100:00000010:2.0:1767323611.082339:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2900. 00010000:00000001:0.0:1767323611.399564:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323611.399575:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323611.399583:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323611.399584:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323611.399702:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323611.399710:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323611.399716:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323612.424700:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323612.424707:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323612.424712:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323612.424759:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323612.424828:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323612.424832:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323612.424836:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323613.448119:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323613.448130:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323613.448140:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323613.448142:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323613.448218:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323613.448226:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323613.448242:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323614.471525:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323614.471532:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323614.471538:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323614.471539:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323614.471630:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323614.471633:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323614.471636:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323614.919533:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323614.919545:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323614.919556:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f11180. 00000020:00000040:2.0:1767323614.919561:0:8:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:2.0:1767323614.919566:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1767323614.919569:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1767323614.919574:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323614.919583:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7600. 00000100:00000001:2.0:1767323614.919590:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919601:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1767323614.919612:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1767323614.919616:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919622:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ac42371] to pc [ptlrpcd_00_02+2] req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323614.919657:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323614.919664:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323614.919668:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f11500. 00000020:00000040:2.0:1767323614.919670:0:8:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:2.0:1767323614.919673:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1767323614.919695:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1767323614.919697:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323614.919701:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7500. 00000100:00000001:2.0:1767323614.919704:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919709:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1767323614.919717:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1767323614.919718:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919722:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f1ef9604] to pc [ptlrpcd_00_03+3] req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323614.919729:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919731:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323614.919734:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1767323614.919737:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941039f12d80. 00000020:00000040:2.0:1767323614.919739:0:8:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:2.0:1767323614.919741:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1767323614.919742:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1767323614.919743:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1767323614.919746:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410083d7100. 00000100:00000001:2.0:1767323614.919749:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919752:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1767323614.919757:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1767323614.919759:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919762:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c5d0fd2a] to pc [ptlrpcd_00_00+0] req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323614.919792:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.919795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1767323614.919799:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:2.0:1767323614.919808:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1767323614.919811:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:2.0:1767323614.919816:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6169) 00000100:00000001:2.0:1767323614.919831:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:2.0:1767323614.919835:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000001:2.0:1767323614.919838:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323614.919845:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323614.919847:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323614.919849:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323614.919850:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323614.919854:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323614.919855:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323614.919857:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323614.919864:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323614.919872:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323614.919874:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323614.919878:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323614.919880:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323614.919883:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323614.919886:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975844352:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323614.919890:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323614.919895:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323614.919897:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323614.919899:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323614.919903:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743ec00. 02000000:00000001:2.0:1767323614.919905:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323614.919910:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35268. 00000400:00000010:2.0:1767323614.919918:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3aa0. 00000100:00000200:2.0:1767323614.919924:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975844352, portal 10 00000100:00000001:2.0:1767323614.919927:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323614.919929:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145335680 : -118677564215936 : ffff941039f12d80) 00000100:00000040:2.0:1767323614.919936:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323614.919952:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323614.919955:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323614.919957:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc33b8. 00000100:00000200:2.0:1767323614.919960:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975844352, offset 0 00000400:00000200:2.0:1767323614.919966:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323614.919979:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323614.919984:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323614.919989:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323614.919993:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323614.919996:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323614.919999:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1514:1514:256:4294967295] 192.168.204.130@tcp LPNI seq info [1514:1514:8:4294967295] 00000100:00000001:0.0:1767323614.920037:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323614.920040:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323614.920042:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323614.920051:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323614.920060:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323614.920061:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323614.920066:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323614.920067:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323614.920069:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323614.920072:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975844224:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323614.920075:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323614.920077:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323614.920078:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323614.920080:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323614.920083:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102030e000. 02000000:00000001:0.0:1767323614.920085:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323614.920088:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716738. 00000400:00000010:0.0:1767323614.920094:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997880. 00000100:00000200:0.0:1767323614.920097:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975844224, portal 10 00000100:00000001:0.0:1767323614.920098:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323614.920099:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145329408 : -118677564222208 : ffff941039f11500) 00000100:00000040:0.0:1767323614.920105:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323614.920111:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323614.920117:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323614.920119:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997cc0. 00000100:00000200:0.0:1767323614.920121:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975844224, offset 0 00000400:00000200:0.0:1767323614.920125:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:1.0:1767323614.920165:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323614.920168:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323614.920170:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323614.920174:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323614.920181:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323614.920182:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323614.920184:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323614.920186:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323614.920188:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323614.920190:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941039f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975844096:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323614.920193:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323614.920195:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323614.920196:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323614.920198:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323614.920201:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010710a00. 02000000:00000001:1.0:1767323614.920203:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323614.920206:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156e70. 00000400:00000010:1.0:1767323614.920209:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890ad48. 00000100:00000200:1.0:1767323614.920212:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975844096, portal 25 00000100:00000001:1.0:1767323614.920213:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323614.920215:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625396145328512 : -118677564223104 : ffff941039f11180) 00000100:00000040:1.0:1767323614.920218:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323614.920223:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323614.920230:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323614.920232:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a110. 00000100:00000200:1.0:1767323614.920234:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975844096, offset 0 00000400:00000200:1.0:1767323614.920237:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323614.920254:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323614.920260:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323614.920264:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7e00. 00000800:00000200:2.0:1767323614.920271:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323614.920278:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323614.920282:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7e00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323614.920297:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.920301:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11301 usecs (12 jiffies) 00000100:00000001:2.0:1767323614.920305:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300831756 00000100:00000010:2.0:1767323614.920308:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49960. 00000100:00000001:2.0:1767323614.920314:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:2.0:1767323614.920319:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300831756 00000100:00000010:2.0:1767323614.920322:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49f60. 00000100:00000001:2.0:1767323614.920324:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:2.0:1767323614.920327:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300831756 00000100:00000010:2.0:1767323614.920329:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49900. 00000100:00000001:2.0:1767323614.920331:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:2.0:1767323614.920338:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300831756 00000100:00000010:2.0:1767323614.920340:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49420. 00000100:00000001:2.0:1767323614.920343:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:2.0:1767323614.920348:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323614.920350:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323614.920352:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323614.920354:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:3.0:1767323614.920506:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323614.920511:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7e00. 00000400:00000200:3.0:1767323614.920516:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323614.920522:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323614.922001:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323614.922006:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323614.922010:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323614.922013:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323614.922016:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323614.922177:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1515:1515:255:4294967295] 192.168.204.130@tcp LPNI seq info [1515:1515:7:4294967295] 00000400:00000200:0.0:1767323614.922188:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323614.922194:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323614.922203:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab300. 00000800:00000200:0.0:1767323614.922208:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323614.922215:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323614.922223:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab300 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323614.922229:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323614.922234:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12415 usecs (13 jiffies) 00000100:00000001:0.0:1767323614.922237:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300831758 00000100:00000001:0.0:1767323614.922244:0:111004:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, simply extend its deadline from 4300831756 00000100:00000001:0.0:1767323614.922248:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300831758 00000100:00000001:0.0:1767323614.922251:0:111004:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, simply extend its deadline from 4300831756 00000100:00000001:0.0:1767323614.922254:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300831758 00000100:00000001:0.0:1767323614.922257:0:111004:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, simply extend its deadline from 4300831756 00000100:00000001:0.0:1767323614.922259:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300831758 00000100:00000001:0.0:1767323614.922262:0:111004:0:(niobuf.c:684:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, simply extend its deadline from 4300831756 00000100:00000001:0.0:1767323614.922266:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323614.922269:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323614.922286:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323614.922288:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323614.922296:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323614.922298:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323614.922300:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323614.922302:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323614.922303:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323614.922305:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:1.0:1767323614.922878:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323614.922882:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323614.922885:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323614.922887:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323614.922890:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323614.922892:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1516:1516:254:4294967295] 192.168.204.130@tcp LPNI seq info [1516:1516:6:4294967295] 00000400:00000200:1.0:1767323614.922901:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323614.922906:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323614.922911:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c900. 00000800:00000200:1.0:1767323614.922915:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323614.922921:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323614.922923:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c900 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323614.922926:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323614.922929:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300833006 00000100:00000001:1.0:1767323614.922933:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300831758 00000100:00000001:1.0:1767323614.922936:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300833006 00000100:00000001:1.0:1767323614.922938:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300831758 00000100:00000001:1.0:1767323614.922941:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300833006 00000100:00000001:1.0:1767323614.922943:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300831758 00000100:00000001:1.0:1767323614.922945:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300833006 00000100:00000001:1.0:1767323614.922948:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300831758 00000100:00000001:1.0:1767323614.922951:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323614.922953:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323614.922956:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323614.922958:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323614.922970:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323614.922971:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323614.922973:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323614.922974:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323614.922976:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323614.922977:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323614.923533:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc33b8 00000400:00000010:3.0:1767323614.923538:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc33b8. 00000100:00000001:3.0:1767323614.923550:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323614.923557:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323614.923567:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323614.923569:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323614.923574:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323614.923576:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:3.0:1767323614.923609:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323614.923614:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab300. 00000400:00000200:3.0:1767323614.923618:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323614.923623:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323614.923626:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997cc0 00000400:00000010:3.0:1767323614.923628:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997cc0. 00000100:00000001:3.0:1767323614.923630:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323614.923634:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323614.923641:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323614.923643:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323614.923649:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323614.923650:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:3.0:1767323614.923706:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323614.923709:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c900. 00000400:00000200:3.0:1767323614.923712:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323614.923716:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323614.923719:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a110 00000400:00000010:3.0:1767323614.923721:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a110. 00000100:00000001:3.0:1767323614.923723:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323614.924936:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323614.924947:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323614.924961:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323614.924967:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323614.924969:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1767323614.924982:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.924992:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323614.924995:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.925008:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323614.925013:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323614.925023:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f200 00000400:00000200:3.0:1767323614.925035:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3151 [1] + 224 00000800:00000001:3.0:1767323614.925041:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.925047:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323614.925048:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323614.925051:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323614.925054:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323614.925058:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323614.925068:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323614.925081:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323614.925086:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.925088:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323614.925197:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323614.925200:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323614.925205:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323614.925207:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323614.925209:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35268. 00000400:00000200:2.0:1767323614.925213:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3aa0 00000400:00000010:2.0:1767323614.925214:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3aa0. 00000100:00000001:2.0:1767323614.925216:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323614.925220:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323614.925226:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323614.925230:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323614.925231:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323614.925232:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323614.925234:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323614.925236:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323614.925237:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323614.925239:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323614.925247:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=66 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323614.925250:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=66 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323614.925252:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323614.925253:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323614.925256:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323614.925259:0:111002:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323614.925263:0:111002:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323614.925271:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323614.925272:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323614.925273:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323614.925275:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323614.925278:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323614.925282:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323614.925284:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323614.925286:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323614.925288:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323614.925293:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975844352:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323614.925296:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323614.925297:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323614.925299:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f12d80 x1853171975844352/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323614.925303:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323614.925304:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323614.925307:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743ec00. 02000000:00000001:2.0:1767323614.925309:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323614.925311:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323614.925313:0:111002:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323614.925316:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323614.925318:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7100. 02000000:00000001:2.0:1767323614.925322:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323614.925323:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323614.925325:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f12d80. 00000100:00000001:2.0:1767323614.925329:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323614.925330:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323614.925332:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323614.925340:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323614.925341:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323614.925349:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323614.925351:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:3.0:1767323614.926131:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.926140:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323614.926143:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.926146:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323614.926153:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323614.926166:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f180 00000400:00000200:3.0:1767323614.926173:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3159 [1] + 224 00000800:00000001:3.0:1767323614.926178:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.926183:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323614.926191:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323614.926195:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323614.926696:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323614.926705:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323614.926714:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323614.926761:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323614.926764:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323614.926780:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1767323614.926886:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323614.926891:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323614.927276:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.927282:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323614.927284:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.927286:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323614.927291:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323614.927302:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953f100 00000400:00000200:3.0:1767323614.927308:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3161 [1] + 224 00000800:00000001:3.0:1767323614.927313:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.927320:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323614.927322:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323614.927325:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323614.927329:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323614.927334:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323614.927343:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323614.927364:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323614.927368:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323614.927371:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323614.927860:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323614.927864:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323614.927870:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323614.927872:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323614.927876:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156e70. 00000400:00000200:1.0:1767323614.927881:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890ad48 00000400:00000010:1.0:1767323614.927883:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890ad48. 00000100:00000001:1.0:1767323614.927887:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323614.927892:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323614.927901:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323614.927908:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323614.927910:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323614.927912:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323614.927915:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323614.927917:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323614.927918:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323614.927922:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323614.927928:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=67 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323614.927931:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=67 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323614.927934:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323614.927935:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323614.927938:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323614.927940:0:111003:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323614.927942:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323614.927946:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323614.927954:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323614.927957:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323614.927971:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323614.927976:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323614.927985:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975844096:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323614.927990:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323614.927992:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323614.927995:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f11180 x1853171975844096/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323614.928001:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323614.928004:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323614.928007:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010710a00. 02000000:00000001:1.0:1767323614.928010:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323614.928012:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323614.928014:0:111003:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:1.0:1767323614.928016:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323614.928019:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7600. 02000000:00000001:1.0:1767323614.928023:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323614.928025:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323614.928027:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f11180. 00000100:00000001:1.0:1767323614.928030:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323614.928032:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323614.928034:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323614.928042:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323614.928044:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323614.928046:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323614.928048:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:0.0:1767323614.928161:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323614.928163:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323614.928165:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716738. 00000400:00000200:0.0:1767323614.928169:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997880 00000400:00000010:0.0:1767323614.928171:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997880. 00000100:00000001:0.0:1767323614.928174:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323614.928179:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323614.928188:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323614.928195:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323614.928196:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323614.928199:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323614.928200:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323614.928271:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323614.928274:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323614.928277:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323614.928283:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=66 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323614.928286:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=66 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323614.928288:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323614.928289:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323614.928291:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323614.928294:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323614.928297:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323614.928300:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323614.928302:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323614.928311:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323614.928316:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323614.928323:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323614.928325:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323614.928327:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323614.928331:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323614.928338:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941039f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975844224:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323614.928343:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323614.928344:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323614.928347:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941039f11500 x1853171975844224/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323630 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323614.928353:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323614.928355:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323614.928357:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102030e000. 02000000:00000001:0.0:1767323614.928360:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323614.928361:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323614.928363:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323614.928364:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323614.928366:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410083d7500. 02000000:00000001:0.0:1767323614.928368:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323614.928370:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323614.928371:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941039f11500. 00000100:00000001:0.0:1767323614.928373:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323614.928375:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323614.928376:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323614.928380:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323614.928381:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323614.928440:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323614.928442:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323615.495591:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323615.495597:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323615.495620:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323615.495622:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323615.495728:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323615.495731:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323615.495734:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323616.199511:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300833006, at 4300833024 00000100:00000010:3.0:1767323616.199547:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49420. 00000100:00000040:0.0:1767323616.199655:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300833006, at 4300833024 00000100:00000010:0.0:1767323616.199673:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49960. 00000100:00000040:2.0:1767323616.199779:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300833006, at 4300833024 00000100:00000010:2.0:1767323616.199786:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49900. 00000100:00000040:1.0:1767323616.200003:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300833006, at 4300833024 00000100:00000010:1.0:1767323616.200009:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49f60. 00010000:00000001:0.0:1767323616.519502:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323616.519509:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323616.519515:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323616.519516:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323616.519758:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323616.519761:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323616.519764:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323617.543502:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323617.543508:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323617.543510:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323617.543512:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323617.543516:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323617.543518:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323617.543519:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323617.543521:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323617.543523:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323617.543524:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323617.544847:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323617.544852:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323617.544855:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323618.567515:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323618.567523:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323618.567530:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323618.567531:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323618.567632:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323618.567636:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323618.567639:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323619.592446:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323619.592455:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323619.592463:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323619.592467:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323619.592470:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323619.592476:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323619.592478:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323619.592480:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323619.592484:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323619.592486:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323619.592488:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323619.592491:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323619.593050:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323619.593054:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323619.593057:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323620.043538:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323620.043547:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323620.043557:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be7480. 00000020:00000040:0.0:1767323620.043577:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323620.043581:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323620.043584:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323620.043589:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323620.043608:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abb00. 00000100:00000001:0.0:1767323620.043615:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.043626:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323620.043637:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323620.043641:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.043647:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d622fa64] to pc [ptlrpcd_00_01+1] req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323620.043707:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323620.043711:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323620.043714:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323620.043720:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323620.043728:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323620.043730:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323620.043734:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323620.043737:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323620.043748:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323620.043752:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975844480:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323620.043756:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323620.043761:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323620.043763:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323620.043766:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323620.043771:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010711800. 02000000:00000001:1.0:1767323620.043773:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323620.043779:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156e70. 00000400:00000010:1.0:1767323620.043786:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890ad48. 00000100:00000200:1.0:1767323620.043793:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975844480, portal 25 00000100:00000001:1.0:1767323620.043795:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323620.043796:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470922880 : -118678238628736 : ffff941011be7480) 00000100:00000040:1.0:1767323620.043801:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323620.043809:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323620.043811:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323620.043815:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a110. 00000100:00000200:1.0:1767323620.043818:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975844480, offset 0 00000400:00000200:1.0:1767323620.043823:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323620.043835:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323620.043841:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323620.043846:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323620.043849:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323620.043858:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323620.043862:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1517:1517:256:4294967295] 192.168.204.130@tcp LPNI seq info [1517:1517:8:4294967295] 00000400:00000200:1.0:1767323620.043874:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323620.043880:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323620.043884:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4cf00. 00000800:00000200:1.0:1767323620.043891:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323620.043900:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323620.043904:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4cf00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323620.043917:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323620.043921:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300838129 00000100:00000010:1.0:1767323620.043925:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5120. 00000100:00000001:1.0:1767323620.043932:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1767323620.043939:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300838129 00000100:00000010:1.0:1767323620.043943:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5180. 00000100:00000001:1.0:1767323620.043945:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:1.0:1767323620.043948:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300838129 00000100:00000010:1.0:1767323620.043951:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5de0. 00000100:00000001:1.0:1767323620.043954:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1767323620.043957:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300838129 00000100:00000010:1.0:1767323620.043959:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5300. 00000100:00000001:1.0:1767323620.043962:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1767323620.043965:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323620.043968:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323620.043970:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323620.043973:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323620.044316:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.044320:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323620.044324:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323620.044328:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5180. 00000020:00000040:0.0:1767323620.044331:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323620.044334:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323620.044336:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323620.044338:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323620.044342:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab900. 00000100:00000001:0.0:1767323620.044346:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.044351:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323620.044359:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323620.044362:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.044366:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000501b1cb0] to pc [ptlrpcd_00_02+2] req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.044405:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.044408:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323620.044421:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323620.044424:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4380. 00000100:00000001:2.0:1767323620.044501:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:2.0:1767323620.044505:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000001:2.0:1767323620.044506:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323620.044514:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323620.044516:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323620.044517:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323620.044518:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323620.044520:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323620.044526:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323620.044533:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323620.044535:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323620.044537:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323620.044539:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323620.044541:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323620.044544:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975844608:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323620.044547:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323620.044549:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323620.044551:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323620.044553:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323620.044556:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410105c3c00. 02000000:00000001:2.0:1767323620.044558:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323620.044562:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35268. 00000400:00000010:2.0:1767323620.044567:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3aa0. 00000100:00000200:2.0:1767323620.044570:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975844608, portal 10 00000100:00000001:2.0:1767323620.044572:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323620.044574:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470913920 : -118678238637696 : ffff941011be5180) 00000100:00000040:2.0:1767323620.044579:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323620.044602:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323620.044604:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323620.044607:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3330. 00000100:00000200:2.0:1767323620.044610:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975844608, offset 0 00000400:00000200:2.0:1767323620.044615:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323620.044622:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323620.044625:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323620.044628:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323620.044631:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323620.044633:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323620.044636:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1518:1518:255:4294967295] 192.168.204.130@tcp LPNI seq info [1518:1518:7:4294967295] 00000400:00000200:2.0:1767323620.044644:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323620.044649:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323620.044653:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7100. 00000800:00000200:2.0:1767323620.044657:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323620.044662:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323620.044665:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7100 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323620.044668:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323620.044672:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12328 usecs (13 jiffies) 00000100:00000001:2.0:1767323620.044674:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300836882 00000100:00000001:2.0:1767323620.044677:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300838129 00000100:00000001:2.0:1767323620.044679:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300836882 00000100:00000001:2.0:1767323620.044681:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300838129 00000100:00000001:2.0:1767323620.044683:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300836882 00000100:00000001:2.0:1767323620.044685:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300838129 00000100:00000001:2.0:1767323620.044688:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300836882 00000100:00000001:2.0:1767323620.044690:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300838129 00000100:00000001:2.0:1767323620.044698:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323620.044700:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323620.044702:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323620.044704:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323620.044717:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323620.044719:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1767323620.044768:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323620.044772:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4cf00. 00000400:00000200:2.0:1767323620.044779:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323620.044785:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323620.044790:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a110 00000400:00000010:2.0:1767323620.044792:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a110. 00000100:00000001:2.0:1767323620.044797:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323620.044802:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323620.044811:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323620.044814:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323620.044820:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323620.044821:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:2.0:1767323620.044890:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:2.0:1767323620.044893:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7100. 00000400:00000200:2.0:1767323620.044896:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323620.044900:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:2.0:1767323620.044903:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3330 00000400:00000010:2.0:1767323620.044904:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3330. 00000100:00000001:2.0:1767323620.044907:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:2.0:1767323620.044910:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323620.044916:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323620.044919:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323620.044925:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323620.044932:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:2.0:1767323620.044950:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323620.044953:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:0.0:1767323620.045346:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323620.045350:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323620.045352:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323620.045355:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323620.045361:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abc00. 00000100:00000001:0.0:1767323620.045365:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.045371:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323620.045379:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323620.045382:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.045408:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000053f49053] to pc [ptlrpcd_00_03+3] req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.045433:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.045436:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323620.045450:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323620.045453:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323620.045456:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323620.045460:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6174) 00000100:00000001:0.0:1767323620.045474:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:0.0:1767323620.045476:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:0.0:1767323620.045477:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323620.045482:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323620.045484:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323620.045486:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323620.045487:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323620.045489:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323620.045493:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.045513:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323620.045515:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323620.045517:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323620.045519:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323620.045521:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323620.045525:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975844736:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323620.045528:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323620.045531:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323620.045533:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323620.045535:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323620.045538:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010e18600. 02000000:00000001:0.0:1767323620.045540:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323620.045544:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716738. 00000400:00000010:0.0:1767323620.045549:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997880. 00000100:00000200:0.0:1767323620.045554:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975844736, portal 10 00000100:00000001:0.0:1767323620.045557:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323620.045558:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470910336 : -118678238641280 : ffff941011be4380) 00000100:00000040:0.0:1767323620.045564:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.045570:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323620.045572:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323620.045575:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997770. 00000100:00000200:0.0:1767323620.045577:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975844736, offset 0 00000400:00000200:0.0:1767323620.045582:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323620.045602:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323620.045609:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323620.045612:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323620.045615:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323620.045617:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323620.045620:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1519:1519:256:4294967295] 192.168.204.130@tcp LPNI seq info [1519:1519:8:4294967295] 00000400:00000200:0.0:1767323620.045628:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323620.045638:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323620.045642:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab700. 00000800:00000200:0.0:1767323620.045647:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323620.045652:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323620.045655:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323620.045666:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.045670:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11022 usecs (12 jiffies) 00000100:00000001:0.0:1767323620.045673:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300836882 00000100:00000001:0.0:1767323620.045676:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300838129 00000100:00000001:0.0:1767323620.045679:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300836882 00000100:00000001:0.0:1767323620.045681:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300838129 00000100:00000001:0.0:1767323620.045683:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300836882 00000100:00000001:0.0:1767323620.045685:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300838129 00000100:00000001:0.0:1767323620.045688:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300836882 00000100:00000001:0.0:1767323620.045690:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300838129 00000100:00000001:0.0:1767323620.045692:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323620.045695:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323620.045697:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323620.045699:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323620.045722:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323620.045725:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab700. 00000400:00000200:0.0:1767323620.045729:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323620.045733:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323620.045736:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997770 00000400:00000010:0.0:1767323620.045739:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997770. 00000100:00000001:0.0:1767323620.045741:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323620.045745:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.045753:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323620.045761:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.045768:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323620.045770:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:2.0:1767323620.045974:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323620.045976:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323620.045978:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323620.046090:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323620.046628:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323620.046632:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323620.046635:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323620.046637:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323620.046639:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323620.046641:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:1.0:1767323620.055207:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323620.055218:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323620.055221:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323620.055223:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323620.055234:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323620.055256:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f300 00000400:00000200:1.0:1767323620.055264:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3171 [1] + 224 00000800:00000001:1.0:1767323620.055272:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323620.055278:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323620.055281:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323620.055286:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323620.055293:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323620.055303:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323620.055314:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323620.055334:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323620.055342:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323620.055347:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323620.055349:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323620.055353:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323620.055357:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323620.055365:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953f280 00000400:00000200:1.0:1767323620.055372:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3169 [1] + 224 00000800:00000001:1.0:1767323620.055376:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323620.055414:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323620.055417:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323620.055421:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323620.055425:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323620.055430:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323620.055476:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323620.055483:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323620.055491:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323620.055492:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000400:00000001:3.0:1767323620.055503:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000800:00000001:1.0:1767323620.055504:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000400:00000001:3.0:1767323620.055509:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000800:00000001:1.0:1767323620.055513:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323620.055529:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323620.055532:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000010:3.0:1767323620.055607:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35268. 00000400:00000200:3.0:1767323620.055617:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3aa0 00000400:00000010:3.0:1767323620.055622:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3aa0. 00000100:00000001:3.0:1767323620.055628:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323620.055641:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323620.055656:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323620.055665:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323620.055668:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323620.055671:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323620.055675:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323620.055678:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323620.055680:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323620.055683:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323620.055694:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=72 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323620.055698:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=72 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323620.055701:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323620.055703:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323620.055706:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323620.055711:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323620.055715:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323620.055718:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323620.055720:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323620.055736:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323620.055741:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323620.055750:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323620.055754:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323620.055756:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323620.055761:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323620.055769:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975844608:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323620.055774:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323620.055778:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323620.055781:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5180 x1853171975844608/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323620.055788:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323620.055791:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323620.055795:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410105c3c00. 02000000:00000001:3.0:1767323620.055799:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323620.055803:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323620.055805:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323620.055807:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323620.055810:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab900. 02000000:00000001:3.0:1767323620.055815:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323620.055818:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323620.055820:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5180. 00000100:00000001:3.0:1767323620.055824:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323620.055825:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323620.055828:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323620.055837:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323620.055839:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323620.055842:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323620.055844:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:1.0:1767323620.056078:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323620.056082:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323620.056086:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156e70. 00000400:00000200:1.0:1767323620.056091:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890ad48 00000400:00000010:1.0:1767323620.056093:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890ad48. 00000100:00000001:1.0:1767323620.056097:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323620.056103:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323620.056113:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323620.056120:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323620.056122:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323620.056656:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323620.056663:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323620.056666:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323620.056668:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323620.056672:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323620.056679:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=73 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323620.056684:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=73 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323620.056687:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323620.056688:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323620.056691:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323620.056693:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323620.056696:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323620.056703:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323620.056727:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323620.056730:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323620.056733:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323620.056738:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323620.056745:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975844480:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323620.056750:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323620.056753:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323620.056756:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be7480 x1853171975844480/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323620.056763:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323620.056765:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323620.056769:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010711800. 02000000:00000001:1.0:1767323620.056773:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323620.056775:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323620.056777:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:1.0:1767323620.056779:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323620.056781:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abb00. 02000000:00000001:1.0:1767323620.056786:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323620.056788:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323620.056790:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be7480. 00000100:00000001:1.0:1767323620.056794:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323620.056795:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323620.056798:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323620.056806:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323620.056808:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323620.056810:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323620.056812:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:2.0:1767323620.058333:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323620.058355:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1767323620.058360:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323620.058362:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323620.058378:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323620.058427:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f380 00000400:00000200:2.0:1767323620.058437:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3179 [1] + 224 00000800:00000001:2.0:1767323620.058446:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323620.058507:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323620.058510:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323620.058525:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:2.0:1767323620.058535:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323620.058546:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323620.058557:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323620.058575:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1767323620.058584:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323620.058588:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323620.059318:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323620.059327:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1767323620.059335:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323620.059337:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323620.059343:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716738. 00000400:00000200:0.0:1767323620.059352:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997880 00000400:00000010:0.0:1767323620.059354:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997880. 00000100:00000001:0.0:1767323620.059359:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323620.059371:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323620.059399:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.059409:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323620.059413:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323620.059417:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323620.059420:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323620.059423:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323620.059425:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323620.059428:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323620.059437:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=72 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323620.059441:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=72 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323620.059444:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323620.059446:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323620.059449:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1767323620.059455:0:111003:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1767323620.059474:0:111003:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323620.059478:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323620.059480:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323620.059482:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323620.059502:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323620.059510:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.059518:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323620.059521:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323620.059523:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323620.059535:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323620.059544:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975844736:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323620.059550:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323620.059553:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323620.059556:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4380 x1853171975844736/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323636 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323620.059563:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323620.059565:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323620.059569:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010e18600. 02000000:00000001:0.0:1767323620.059574:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323620.059577:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323620.059578:0:111003:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323620.059581:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323620.059583:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abc00. 02000000:00000001:0.0:1767323620.059587:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323620.059597:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323620.059599:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4380. 00000100:00000001:0.0:1767323620.059603:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323620.059604:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323620.059606:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323620.059614:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323620.059616:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323620.059618:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323620.059621:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323620.615612:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323620.615622:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323620.615658:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323620.615660:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323620.615783:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323620.615788:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323620.615791:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323621.319467:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300838129, at 4300838144 00000100:00000010:1.0:1767323621.319497:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5180. 00000100:00000040:3.0:1767323621.320635:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300838129, at 4300838144 00000100:00000010:3.0:1767323621.320645:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5300. 00000100:00000040:2.0:1767323621.320733:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300838129, at 4300838144 00000100:00000010:2.0:1767323621.320738:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5de0. 00000100:00000040:0.0:1767323621.323440:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300838129, at 4300838148 00000100:00000010:0.0:1767323621.323453:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5120. 00010000:00000001:0.0:1767323621.640849:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323621.640859:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323621.640869:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323621.640871:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323621.642772:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323621.642779:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323621.642784:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323622.663607:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323622.663613:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323622.663619:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323622.663621:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323622.663747:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323622.663751:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323622.663754:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323623.687623:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323623.687633:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323623.687640:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323623.687641:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323623.688058:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323623.688062:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323623.688066:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323624.712928:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323624.712939:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323624.712946:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323624.712948:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323624.713142:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323624.713147:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323624.713151:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323625.161748:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323625.161764:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323625.161779:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4380. 00000020:00000040:0.0:1767323625.161788:0:8:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323625.161793:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323625.161796:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323625.161804:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323625.161815:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abc00. 00000100:00000001:0.0:1767323625.161825:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.161841:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323625.161855:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323625.161861:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.161870:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000053f49053] to pc [ptlrpcd_00_00+0] req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323625.161939:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.161943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323625.161947:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323625.161951:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6a00. 00000020:00000040:0.0:1767323625.161953:0:8:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323625.161955:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323625.161957:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323625.161959:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323625.161963:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab700. 00000100:00000001:0.0:1767323625.161966:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.161971:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323625.161978:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323625.161981:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.161985:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000515a4373] to pc [ptlrpcd_00_01+1] req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323625.161993:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.161995:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323625.161998:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323625.162002:0:8:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4700. 00000020:00000040:0.0:1767323625.162004:0:8:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323625.162006:0:8:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323625.162007:0:8:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323625.162009:0:8:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323625.162014:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abb00. 00000100:00000001:0.0:1767323625.162017:0:8:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.162021:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323625.162027:0:8:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323625.162043:0:8:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.162049:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a8eec513] to pc [ptlrpcd_00_02+2] req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323625.162084:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323625.162087:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323625.162091:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323625.162094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323625.162097:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323625.162103:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6179) 00000100:00000001:1.0:1767323625.162350:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323625.162355:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323625.162358:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323625.162365:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.162375:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323625.162377:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323625.162426:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323625.162430:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323625.162433:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323625.162437:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975844992:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323625.162442:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323625.162450:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323625.162453:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323625.162456:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323625.162462:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010710400. 02000000:00000001:1.0:1767323625.162465:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323625.162473:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156e70. 00000400:00000010:1.0:1767323625.162481:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890ad48. 00000100:00000200:1.0:1767323625.162490:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975844992, portal 10 00000100:00000001:1.0:1767323625.162493:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323625.162494:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470920192 : -118678238631424 : ffff941011be6a00) 00000100:00000040:1.0:1767323625.162512:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.162520:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323625.162523:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323625.162533:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890add0. 00000100:00000200:1.0:1767323625.162537:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975844992, offset 0 00000400:00000200:1.0:1767323625.162545:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323625.162564:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323625.162571:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323625.162577:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323625.162582:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323625.162585:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323625.162589:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1520:1520:256:4294967295] 192.168.204.130@tcp LPNI seq info [1520:1520:8:4294967295] 00000400:00000200:1.0:1767323625.162609:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323625.162617:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323625.162623:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c700. 00000800:00000200:1.0:1767323625.162632:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323625.162642:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323625.162647:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323625.162656:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323625.162661:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12410 usecs (13 jiffies) 00000100:00000001:1.0:1767323625.162665:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300842000 00000100:00000010:1.0:1767323625.162670:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5de0. 00000100:00000001:1.0:1767323625.162678:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:1.0:1767323625.162690:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300842000 00000100:00000010:1.0:1767323625.162695:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5120. 00000100:00000001:1.0:1767323625.162698:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:1.0:1767323625.162701:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300842000 00000100:00000010:1.0:1767323625.162705:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5720. 00000100:00000001:1.0:1767323625.162709:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:1.0:1767323625.162715:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300842000 00000100:00000010:1.0:1767323625.162719:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5180. 00000100:00000001:1.0:1767323625.162723:0:111002:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:1.0:1767323625.162736:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323625.162740:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.162743:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.162747:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.162756:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323625.162758:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323625.162761:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323625.162762:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323625.162763:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323625.162766:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000001:1.0:1767323625.162768:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.162769:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323625.162770:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.162772:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323625.162773:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323625.162774:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323625.162778:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.162784:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323625.162786:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323625.162788:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323625.162790:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323625.162792:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323625.162794:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975844864:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323625.162798:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323625.162800:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323625.162802:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323625.162803:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323625.162806:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010711000. 02000000:00000001:1.0:1767323625.162808:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323625.162813:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156160. 00000400:00000010:1.0:1767323625.162817:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a198. 00000100:00000200:1.0:1767323625.162820:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975844864, portal 25 00000100:00000001:1.0:1767323625.162822:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323625.162824:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470910336 : -118678238641280 : ffff941011be4380) 00000100:00000040:1.0:1767323625.162835:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.162842:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323625.162845:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323625.162848:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890aa18. 00000100:00000200:1.0:1767323625.162851:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975844864, offset 0 00000400:00000200:1.0:1767323625.162856:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323625.162861:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323625.162864:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323625.162867:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323625.162869:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000800:00000200:0.0:1767323625.163403:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323625.163409:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c700. 00000400:00000200:0.0:1767323625.163416:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323625.163422:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323625.163464:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323625.163470:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1521:1521:255:4294967295] 192.168.204.130@tcp LPNI seq info [1521:1521:7:4294967295] 00000400:00000200:1.0:1767323625.163481:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323625.163486:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323625.163492:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c700. 00000800:00000200:1.0:1767323625.163507:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323625.163513:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323625.163516:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323625.163521:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.163524:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300843249 00000100:00000001:1.0:1767323625.163532:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300842000 00000100:00000001:1.0:1767323625.163536:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300843249 00000100:00000001:1.0:1767323625.163539:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300842000 00000100:00000001:1.0:1767323625.163542:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300843249 00000100:00000001:1.0:1767323625.163544:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300842000 00000100:00000001:1.0:1767323625.163548:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300843249 00000100:00000001:1.0:1767323625.163551:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300842000 00000100:00000001:1.0:1767323625.163563:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323625.163566:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.163569:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.163572:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323625.163835:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323625.163839:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323625.163976:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323625.163980:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323625.163983:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323625.163994:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323625.164003:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323625.164004:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323625.164008:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323625.164011:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323625.164022:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323625.164025:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975845120:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323625.164030:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323625.164034:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323625.164037:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323625.164039:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323625.164045:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5000. 02000000:00000001:3.0:1767323625.164047:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323625.164053:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328b58. 00000400:00000010:3.0:1767323625.164061:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec110. 00000100:00000200:3.0:1767323625.164066:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975845120, portal 10 00000100:00000001:3.0:1767323625.164069:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323625.164070:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470911232 : -118678238640384 : ffff941011be4700) 00000100:00000040:3.0:1767323625.164077:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323625.164085:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323625.164087:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323625.164090:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec6e8. 00000100:00000200:3.0:1767323625.164101:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975845120, offset 0 00000400:00000200:3.0:1767323625.164107:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323625.167432:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890add0 00000400:00000010:0.0:1767323625.167447:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890add0. 00000100:00000001:0.0:1767323625.167459:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323625.167475:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323625.167491:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323625.167506:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323625.167514:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323625.167517:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323625.168151:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323625.168157:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c700. 00000400:00000200:1.0:1767323625.168164:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323625.168171:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323625.168177:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890aa18 00000400:00000010:1.0:1767323625.168180:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890aa18. 00000100:00000001:1.0:1767323625.168184:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323625.168189:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.168199:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323625.168202:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.168210:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.168212:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:1.0:1767323625.168248:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323625.168254:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323625.168428:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323625.168437:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323625.168443:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323625.168448:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323625.168451:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323625.168455:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1522:1522:256:4294967295] 192.168.204.130@tcp LPNI seq info [1522:1522:8:4294967295] 00000400:00000200:3.0:1767323625.168469:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323625.168478:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000001:0.0:1767323625.168684:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323625.168700:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323625.168703:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323625.168706:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323625.168714:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323625.168730:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f480 00000400:00000200:0.0:1767323625.168741:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3181 [1] + 224 00000800:00000001:0.0:1767323625.168774:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323625.168785:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323625.168787:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323625.168791:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323625.168797:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323625.168804:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323625.168815:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323625.168887:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323625.168891:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000800:00000010:1.0:1767323625.168925:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c700. 00000800:00000200:1.0:1767323625.168934:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323625.168943:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323625.168948:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323625.168968:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323625.168975:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11403 usecs (12 jiffies) 00000100:00000001:1.0:1767323625.168980:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300842005 00000100:00000001:1.0:1767323625.168985:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300843249 00000100:00000001:1.0:1767323625.168988:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300842005 00000100:00000001:1.0:1767323625.168990:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300843249 00000100:00000001:1.0:1767323625.168993:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300842005 00000100:00000001:1.0:1767323625.169002:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300843249 00000100:00000001:1.0:1767323625.169004:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300842005 00000100:00000001:1.0:1767323625.169007:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300843249 00000100:00000001:1.0:1767323625.169010:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323625.169023:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.169027:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.169031:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.169042:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323625.169044:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323625.169047:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323625.169048:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323625.169050:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.169053:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323625.169190:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000200:0.0:1767323625.169433:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323625.169438:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c700. 00000400:00000200:0.0:1767323625.169443:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323625.169448:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323625.169453:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec6e8 00000400:00000010:0.0:1767323625.169455:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec6e8. 00000100:00000001:0.0:1767323625.169459:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323625.169465:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323625.169476:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323625.169480:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323625.169487:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323625.169489:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:0.0:1767323625.169495:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323625.169511:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000001:2.0:1767323625.170309:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323625.170314:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323625.170336:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156e70. 00000400:00000200:2.0:1767323625.170341:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890ad48 00000400:00000010:2.0:1767323625.170344:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890ad48. 00000100:00000001:2.0:1767323625.170349:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323625.170357:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323625.170366:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323625.170375:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323625.170377:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323625.170380:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323625.171316:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323625.171321:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323625.171324:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323625.171329:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323625.171342:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=77 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323625.171348:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=77 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323625.171351:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323625.171353:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323625.171357:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323625.171361:0:111002:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323625.171366:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323625.171369:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323625.171372:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323625.171374:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323625.171410:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323625.171419:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323625.171423:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323625.171425:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323625.171429:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323625.171437:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975844992:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323625.171458:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323625.171461:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323625.171465:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be6a00 x1853171975844992/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323625.171471:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323625.171475:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323625.171479:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010710400. 02000000:00000001:2.0:1767323625.171486:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323625.171490:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323625.171492:0:111002:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323625.171494:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323625.171508:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab700. 02000000:00000001:2.0:1767323625.171513:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323625.171515:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323625.171518:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6a00. 00000100:00000001:2.0:1767323625.171522:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323625.171524:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323625.171528:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323625.171531:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323625.171534:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323625.171537:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323625.171539:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:1.0:1767323625.180291:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323625.180318:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323625.180324:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323625.180327:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323625.180342:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323625.180367:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953f400 00000400:00000200:1.0:1767323625.180379:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3189 [1] + 224 00000800:00000001:1.0:1767323625.180432:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323625.180449:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323625.180452:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323625.180458:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323625.180468:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323625.180906:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323625.180923:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323625.181004:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323625.181009:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323625.181036:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323625.181054:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323625.181059:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323625.181562:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323625.181573:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323625.181576:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323625.181578:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323625.181586:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323625.181599:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f500 00000400:00000200:0.0:1767323625.181616:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3191 [1] + 224 00000800:00000001:0.0:1767323625.181623:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323625.181694:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323625.181698:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323625.181702:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323625.181707:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323625.181716:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323625.181727:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323625.181745:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323625.181751:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323625.181755:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.184096:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323625.184107:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323625.184120:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323625.184123:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323625.184129:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328b58. 00000400:00000200:1.0:1767323625.184142:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec110 00000400:00000010:1.0:1767323625.184145:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec110. 00000100:00000001:1.0:1767323625.184153:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323625.184170:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323625.184183:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.184191:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323625.184193:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.184196:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323625.184201:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323625.184204:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323625.184206:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323625.184211:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323625.184223:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=77 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323625.184228:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=77 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323625.184231:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323625.184234:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323625.184237:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:1.0:1767323625.184243:0:111003:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1767323625.184249:0:111003:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.184254:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323625.184256:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323625.184259:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323625.184261:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323625.184265:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.184273:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323625.184301:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323625.184304:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323625.184309:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323625.184317:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975845120:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323625.184323:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.184326:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323625.184329:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4700 x1853171975845120/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323625.184337:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323625.184341:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323625.184345:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5000. 02000000:00000001:1.0:1767323625.184350:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323625.184353:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323625.184355:0:111003:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:1.0:1767323625.184358:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323625.184362:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abb00. 02000000:00000001:1.0:1767323625.184367:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323625.184369:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323625.184371:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4700. 00000100:00000001:1.0:1767323625.184375:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323625.184377:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.184380:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323625.184446:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323625.184449:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323625.184451:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323625.184454:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:2.0:1767323625.186098:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323625.186106:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323625.186111:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156160. 00000400:00000200:2.0:1767323625.186124:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a198 00000400:00000010:2.0:1767323625.186127:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a198. 00000100:00000001:2.0:1767323625.186133:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323625.186145:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323625.186157:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323625.186166:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323625.186186:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323625.186189:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323625.186191:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323625.186194:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323625.186196:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323625.186199:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323625.186206:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=78 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323625.186210:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=78 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323625.186212:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323625.186214:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323625.186217:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323625.186220:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323625.186223:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323625.186227:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323625.186235:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323625.186238:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323625.186240:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323625.186243:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323625.186251:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975844864:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323625.186256:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323625.186259:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323625.186262:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4380 x1853171975844864/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323641 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323625.186274:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323625.186277:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323625.186280:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010711000. 02000000:00000001:2.0:1767323625.186284:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323625.186287:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323625.186288:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:2.0:1767323625.186291:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323625.186293:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abc00. 02000000:00000001:2.0:1767323625.186302:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323625.186304:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323625.186306:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4380. 00000100:00000001:2.0:1767323625.186310:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323625.186311:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323625.186314:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323625.186322:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323625.186324:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323625.186327:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323625.186330:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323625.735573:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323625.735584:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323625.735591:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323625.735593:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323625.737941:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323625.737950:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323625.737956:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323626.439511:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300843249, at 4300843264 00000100:00000040:3.0:1767323626.439522:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300843249, at 4300843264 00000100:00000010:0.0:1767323626.439532:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5de0. 00000100:00000010:3.0:1767323626.439539:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5180. 00000100:00000040:2.0:1767323626.439720:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300843249, at 4300843264 00000100:00000010:2.0:1767323626.439727:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5720. 00000100:00000040:1.0:1767323626.439789:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300843249, at 4300843264 00000100:00000010:1.0:1767323626.439795:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5120. 00010000:00000001:0.0:1767323626.759797:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323626.759803:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323626.759807:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323626.759808:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323626.760333:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323626.760336:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323626.760340:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323627.783577:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323627.783588:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323627.783591:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323627.783594:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323627.783610:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323627.783613:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323627.783616:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323627.783618:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323627.783623:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323627.783624:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323627.783779:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323627.783783:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323627.783799:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323628.807575:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323628.807583:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323628.807589:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323628.807591:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323628.807862:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323628.807887:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323628.807892:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323629.833724:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323629.833731:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323629.833737:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323629.833741:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323629.833743:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323629.833748:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323629.833750:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323629.833752:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323629.833756:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323629.833758:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323629.833760:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323629.833762:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323629.836312:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323629.836319:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323629.836323:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323630.281882:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323630.281898:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323630.282093:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3fb80. 00000020:00000040:1.0:1767323630.282105:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:1.0:1767323630.282110:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323630.282113:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323630.282119:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323630.282128:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cf00. 00000100:00000001:1.0:1767323630.282135:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282167:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323630.282179:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323630.282183:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282190:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f4b3802c] to pc [ptlrpcd_00_03+3] req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.282235:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282239:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323630.282243:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323630.282247:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3ed80. 00000020:00000040:1.0:1767323630.282249:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323630.282252:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323630.282253:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323630.282255:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323630.282258:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c900. 00000100:00000001:1.0:1767323630.282261:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282266:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323630.282273:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323630.282276:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282295:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000027ff6961] to pc [ptlrpcd_00_00+0] req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.282465:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282468:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323630.282471:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323630.282475:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d180. 00000020:00000040:1.0:1767323630.282477:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323630.282479:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323630.282481:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323630.282483:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323630.282487:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c000. 00000100:00000001:1.0:1767323630.282490:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282494:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323630.282501:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323630.282503:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282508:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000be4d0d7d] to pc [ptlrpcd_00_01+1] req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.282629:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.282631:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1767323630.282635:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323630.282638:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1767323630.282641:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323630.282646:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6184) 00000100:00000001:0.0:1767323630.282756:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:0.0:1767323630.282761:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:0.0:1767323630.282763:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323630.282770:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323630.282772:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323630.282774:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323630.282776:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323630.282778:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323630.282784:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323630.282792:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323630.282794:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323630.282797:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323630.282800:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323630.282803:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323630.282806:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975845248:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323630.282810:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323630.282822:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323630.282825:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323630.282827:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323630.282838:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010e19000. 02000000:00000001:0.0:1767323630.282840:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323630.282846:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716738. 00000400:00000010:0.0:1767323630.282853:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997880. 00000100:00000200:0.0:1767323630.282860:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975845248, portal 25 00000100:00000001:0.0:1767323630.282863:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323630.282864:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456605056 : -118678252946560 : ffff941010e3fb80) 00000100:00000040:0.0:1767323630.282870:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323630.282877:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323630.282880:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323630.282883:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997770. 00000100:00000200:0.0:1767323630.282886:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975845248, offset 0 00000400:00000200:0.0:1767323630.282892:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323630.282905:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323630.282911:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323630.282915:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323630.282919:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323630.282921:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323630.282925:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1523:1523:256:4294967295] 192.168.204.130@tcp LPNI seq info [1523:1523:8:4294967295] 00000400:00000200:0.0:1767323630.282936:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323630.282942:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323630.282947:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab900. 00000800:00000200:0.0:1767323630.282954:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323630.282962:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323630.282966:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab900 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323630.282989:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323630.282993:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300848368 00000100:00000010:0.0:1767323630.282997:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba20c0. 00000100:00000001:0.0:1767323630.283004:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:0.0:1767323630.283009:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300848368 00000100:00000010:0.0:1767323630.283019:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2a20. 00000100:00000001:0.0:1767323630.283022:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:0.0:1767323630.283025:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300848368 00000100:00000010:0.0:1767323630.283028:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2120. 00000100:00000001:0.0:1767323630.283031:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1767323630.283033:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300848368 00000100:00000010:0.0:1767323630.283036:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2f00. 00000100:00000001:0.0:1767323630.283038:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1767323630.283042:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323630.283044:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323630.283047:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323630.283049:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323630.283189:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323630.283193:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab900. 00000400:00000200:1.0:1767323630.283199:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323630.283204:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323630.283214:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997770 00000400:00000010:1.0:1767323630.283216:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997770. 00000100:00000001:1.0:1767323630.283220:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323630.283224:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.283233:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323630.283236:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.283243:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323630.283244:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:2.0:1767323630.283411:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323630.283414:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323630.283416:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323630.283432:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.283439:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323630.283441:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323630.283443:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323630.283445:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323630.283447:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323630.283450:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975845376:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323630.283453:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323630.283456:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323630.283458:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323630.283459:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323630.283464:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743e200. 02000000:00000001:2.0:1767323630.283465:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323630.283469:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35d10. 00000400:00000010:2.0:1767323630.283473:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3330. 00000100:00000200:2.0:1767323630.283476:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975845376, portal 10 00000100:00000001:2.0:1767323630.283477:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323630.283479:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456601472 : -118678252950144 : ffff941010e3ed80) 00000100:00000040:2.0:1767323630.283485:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.283497:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323630.283499:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323630.283502:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3198. 00000100:00000200:2.0:1767323630.283504:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975845376, offset 0 00000400:00000200:2.0:1767323630.283508:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323630.283640:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323630.283644:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323630.283647:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323630.283650:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323630.283652:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323630.283655:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1524:1524:256:4294967295] 192.168.204.130@tcp LPNI seq info [1524:1524:8:4294967295] 00000400:00000200:2.0:1767323630.283662:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323630.283666:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323630.283671:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7100. 00000800:00000200:2.0:1767323630.283676:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323630.283680:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323630.283683:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7100 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323630.283700:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323630.283704:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12377 usecs (13 jiffies) 00000100:00000001:2.0:1767323630.283707:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300847121 00000100:00000001:2.0:1767323630.283709:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300848368 00000100:00000001:2.0:1767323630.283711:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300847121 00000100:00000001:2.0:1767323630.283713:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300848368 00000100:00000001:2.0:1767323630.283715:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300847121 00000100:00000001:2.0:1767323630.283717:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300848368 00000100:00000001:2.0:1767323630.283719:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300847121 00000100:00000001:2.0:1767323630.283721:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300848368 00000100:00000001:2.0:1767323630.283728:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323630.283731:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323630.283733:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323630.283735:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.283741:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323630.283743:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323630.283745:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323630.283746:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323630.283747:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323630.283750:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000001:2.0:1767323630.283751:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.283753:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323630.283754:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.283756:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323630.283757:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323630.283758:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323630.283763:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.283769:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323630.283771:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323630.283773:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323630.283775:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323630.283777:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323630.283780:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975845504:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323630.283783:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323630.283786:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323630.283788:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323630.283790:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323630.283793:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743e800. 02000000:00000001:2.0:1767323630.283795:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323630.283798:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323630.283802:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3a18. 00000100:00000200:2.0:1767323630.283805:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975845504, portal 10 00000100:00000001:2.0:1767323630.283807:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323630.283808:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456594304 : -118678252957312 : ffff941010e3d180) 00000100:00000040:2.0:1767323630.283818:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.283824:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323630.283826:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323630.283829:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3000. 00000100:00000200:2.0:1767323630.283831:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975845504, offset 0 00000400:00000200:2.0:1767323630.283836:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323630.283841:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323630.283843:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323630.283846:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323630.283848:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323630.283851:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323630.283854:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1525:1525:255:4294967295] 192.168.204.130@tcp LPNI seq info [1525:1525:7:4294967295] 00000400:00000200:2.0:1767323630.283861:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323630.283866:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323630.283869:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7900. 00000800:00000200:2.0:1767323630.283873:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323630.283877:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323630.283880:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7900 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323630.283883:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323630.283886:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 12307 usecs (13 jiffies) 00000100:00000001:2.0:1767323630.283888:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300847121 00000100:00000001:2.0:1767323630.283891:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300848368 00000100:00000001:2.0:1767323630.283893:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300847121 00000100:00000001:2.0:1767323630.283895:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300848368 00000100:00000001:2.0:1767323630.283897:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300847121 00000100:00000001:2.0:1767323630.283899:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300848368 00000100:00000001:2.0:1767323630.283901:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300847121 00000100:00000001:2.0:1767323630.283909:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300848368 00000100:00000001:2.0:1767323630.283911:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323630.283913:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323630.283915:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323630.283917:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323630.283930:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323630.283932:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323630.284011:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323630.284014:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7100. 00000400:00000200:1.0:1767323630.284019:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323630.284023:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323630.284026:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3198 00000400:00000010:1.0:1767323630.284028:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3198. 00000100:00000001:1.0:1767323630.284031:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323630.284035:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.284042:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323630.284045:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.284051:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323630.284053:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323630.284759:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323630.284763:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7900. 00000400:00000200:1.0:1767323630.284768:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323630.284772:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323630.284776:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3000 00000400:00000010:1.0:1767323630.284778:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3000. 00000100:00000001:1.0:1767323630.284780:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323630.284785:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.284806:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323630.284810:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.284816:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323630.284818:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:3.0:1767323630.285041:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323630.285045:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323630.285895:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323630.285911:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323630.285914:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323630.285927:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323630.285936:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323630.285950:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953f580 00000400:00000200:0.0:1767323630.285959:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3199 [1] + 224 00000800:00000001:0.0:1767323630.285966:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323630.285974:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323630.285976:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323630.285980:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323630.285984:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323630.285990:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323630.285999:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323630.286020:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323630.286026:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323630.286029:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323630.286140:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323630.286143:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323630.286149:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323630.286151:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323630.286154:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716738. 00000400:00000200:1.0:1767323630.286158:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997880 00000400:00000010:1.0:1767323630.286160:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997880. 00000100:00000001:1.0:1767323630.286162:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323630.286167:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323630.286175:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.286181:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323630.286183:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323630.286185:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323630.286188:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323630.286191:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323630.286193:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323630.286196:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323630.286202:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=83 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323630.286206:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=83 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323630.286209:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323630.286210:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323630.286213:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323630.286216:0:111003:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323630.286218:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323630.286222:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.286238:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323630.286241:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323630.286243:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323630.286247:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323630.286254:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975845248:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323630.286258:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323630.286260:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323630.286263:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3fb80 x1853171975845248/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.286269:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323630.286272:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323630.286275:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010e19000. 02000000:00000001:1.0:1767323630.286279:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323630.286281:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323630.286283:0:111003:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:1.0:1767323630.286286:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323630.286289:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cf00. 02000000:00000001:1.0:1767323630.286292:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323630.286293:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323630.286295:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3fb80. 00000100:00000001:1.0:1767323630.286298:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323630.286299:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323630.286301:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323630.286489:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323630.286492:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323630.286494:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323630.286496:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:1.0:1767323630.286824:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323630.286831:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323630.286833:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323630.286835:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323630.286841:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323630.286857:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f600 00000400:00000200:1.0:1767323630.286863:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31a1 [1] + 224 00000800:00000001:1.0:1767323630.286868:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323630.286873:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323630.286875:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323630.286878:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323630.286882:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323630.286887:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323630.286896:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.286924:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323630.286932:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323630.286936:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323630.286938:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323630.286940:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323630.286944:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323630.286950:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f680 00000400:00000200:1.0:1767323630.286954:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31a9 [1] + 224 00000800:00000001:1.0:1767323630.286957:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323630.286995:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323630.286998:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323630.287001:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323630.287004:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323630.287007:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323630.287015:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323630.287021:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323630.287032:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323630.287034:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.287650:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323630.287654:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323630.287660:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323630.287662:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323630.287664:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323630.287669:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3a18 00000400:00000010:2.0:1767323630.287671:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3a18. 00000100:00000001:2.0:1767323630.287675:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323630.287682:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323630.287691:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.287699:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323630.287700:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.287702:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323630.287705:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323630.287707:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323630.287708:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323630.287711:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323630.287717:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=82 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323630.287721:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=82 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323630.287723:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323630.287725:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323630.287727:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323630.287731:0:111001:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323630.287739:0:111001:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323630.287752:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323630.287754:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323630.287756:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323630.287758:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323630.287762:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.287768:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323630.287771:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323630.287773:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323630.287777:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323630.287785:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975845504:192.168.204.130@tcp:400:kworker.0 00000400:00000001:2.0:1767323630.287791:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323630.287792:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323630.287794:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35d10. 00000400:00000200:2.0:1767323630.287797:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3330 00000400:00000010:2.0:1767323630.287798:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3330. 00000100:00000001:2.0:1767323630.287800:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323630.287804:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323630.287811:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.287817:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323630.287819:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.287820:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323630.287822:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323630.287823:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323630.287824:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323630.287826:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323630.287830:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=82 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323630.287833:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=82 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323630.287835:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323630.287841:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323630.287843:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323630.287845:0:111001:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323630.287847:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323630.287848:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323630.287850:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323630.287851:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323630.287856:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.287862:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323630.287864:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323630.287866:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323630.287869:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323630.287876:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975845376:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323630.287880:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.287882:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323630.287885:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3d180 x1853171975845504/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.287891:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323630.287893:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323630.287895:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743e800. 02000000:00000001:2.0:1767323630.287898:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323630.287900:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323630.287902:0:111001:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323630.287904:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323630.287905:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c000. 02000000:00000001:2.0:1767323630.287908:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323630.287910:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323630.287911:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d180. 00000100:00000001:2.0:1767323630.287915:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323630.287916:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.287917:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323630.287936:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3ed80 x1853171975845376/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323646 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323630.287942:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323630.287944:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323630.287946:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743e200. 02000000:00000001:2.0:1767323630.287948:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323630.287949:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323630.287951:0:111001:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323630.287953:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323630.287954:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c900. 02000000:00000001:2.0:1767323630.287956:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323630.287957:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323630.287958:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3ed80. 00000100:00000001:2.0:1767323630.287960:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323630.287961:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.287963:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323630.287969:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323630.287971:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323630.287972:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323630.287975:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323630.855531:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323630.855537:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323630.855540:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323630.855541:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323630.855754:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323630.855757:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323630.855759:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323631.559539:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300848368, at 4300848384 00000100:00000010:0.0:1767323631.559557:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba20c0. 00000100:00000040:3.0:1767323631.559659:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300848368, at 4300848384 00000100:00000010:3.0:1767323631.559664:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2f00. 00000100:00000040:1.0:1767323631.559909:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300848368, at 4300848384 00000100:00000010:1.0:1767323631.559916:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2a20. 00000100:00000040:2.0:1767323631.561824:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300848368, at 4300848386 00000100:00000010:2.0:1767323631.561837:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2120. 00010000:00000001:0.0:1767323631.881726:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323631.881736:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323631.881744:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323631.881818:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323631.881886:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323631.881894:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323631.881900:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323632.904213:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323632.904233:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323632.904240:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323632.904242:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323632.904370:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323632.904375:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323632.904401:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323633.927607:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323633.927619:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323633.927628:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323633.927629:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323633.928007:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323633.928012:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323633.928015:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323634.951557:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323634.951567:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323634.951574:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323634.951575:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323634.951683:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323634.951687:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323634.951691:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323635.399606:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323635.399621:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323635.399635:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3fb80. 00000020:00000040:1.0:1767323635.399643:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:1.0:1767323635.399648:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323635.399652:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323635.399659:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323635.399669:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cf00. 00000100:00000001:1.0:1767323635.399678:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.399692:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323635.399704:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323635.399710:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.399717:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f4b3802c] to pc [ptlrpcd_00_02+2] req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.400016:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.400019:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323635.400024:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323635.400030:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3ed80. 00000020:00000040:1.0:1767323635.400052:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323635.400055:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323635.400056:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323635.400059:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323635.400063:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cb00. 00000100:00000001:1.0:1767323635.400066:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.400072:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323635.400080:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323635.400082:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.400086:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000027ff6961] to pc [ptlrpcd_00_03+3] req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.400107:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.400109:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323635.400113:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323635.400116:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d180. 00000020:00000040:1.0:1767323635.400119:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323635.400121:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323635.400122:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323635.400124:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323635.400127:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c100. 00000100:00000001:1.0:1767323635.400130:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.400133:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323635.400140:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323635.400142:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.400155:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000be4d0d7d] to pc [ptlrpcd_00_00+0] req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.400191:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323635.400194:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1767323635.400214:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323635.400217:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1767323635.400219:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000040:1.0:1767323635.400222:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000001:2.0:1767323635.400226:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323635.400230:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323635.400231:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6189) 00000100:00000040:2.0:1767323635.400239:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323635.400251:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323635.400253:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323635.400255:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323635.400259:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323635.400261:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323635.400266:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323635.400270:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323635.400283:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975845888:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323635.400289:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323635.400304:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323635.400318:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323635.400322:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323635.400328:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fc00. 02000000:00000001:2.0:1767323635.400330:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323635.400338:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35d10. 00000400:00000010:2.0:1767323635.400348:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3330. 00000100:00000200:2.0:1767323635.400358:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975845888, portal 10 00000100:00000001:2.0:1767323635.400361:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323635.400363:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456594304 : -118678252957312 : ffff941010e3d180) 00000100:00000040:2.0:1767323635.400371:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323635.400381:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323635.400414:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000100:00000001:0.0:1767323635.400417:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000010:2.0:1767323635.400419:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3a18. 00000100:00000001:0.0:1767323635.400422:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000200:2.0:1767323635.400424:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975845888, offset 0 00000100:00000001:0.0:1767323635.400425:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323635.400436:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:2.0:1767323635.400438:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:0.0:1767323635.400447:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323635.400450:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323635.400453:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323635.400455:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323635.400457:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323635.400462:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975845632:192.168.204.130@tcp:400:kworker.0 00000400:00000200:2.0:1767323635.400465:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000100:00000001:0.0:1767323635.400468:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323635.400473:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000400:00000200:2.0:1767323635.400474:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323635.400480:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323635.400486:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 02000000:00000001:0.0:1767323635.400486:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323635.400490:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000400:00000200:2.0:1767323635.400493:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 02000000:00000010:0.0:1767323635.400497:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010e19e00. 00000400:00000200:2.0:1767323635.400500:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1526:1526:256:4294967295] 192.168.204.130@tcp LPNI seq info [1526:1526:8:4294967295] 02000000:00000001:0.0:1767323635.400501:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323635.400508:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716630. 00000400:00000010:0.0:1767323635.400516:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997f68. 00000400:00000200:2.0:1767323635.400520:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000200:0.0:1767323635.400522:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975845632, portal 25 00000100:00000001:0.0:1767323635.400526:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323635.400528:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456605056 : -118678252946560 : ffff941010e3fb80) 00000800:00000200:2.0:1767323635.400531:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000100:00000040:0.0:1767323635.400537:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000010:2.0:1767323635.400540:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7900. 00000100:00000001:0.0:1767323635.400548:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000800:00000200:2.0:1767323635.400553:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000100:00000040:0.0:1767323635.400555:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323635.400560:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089974c8. 00000100:00000200:0.0:1767323635.400563:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975845632, offset 0 00000800:00000200:2.0:1767323635.400568:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000400:00000200:0.0:1767323635.400574:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000800:00000200:2.0:1767323635.400576:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7900 type 1, nob 320 niov 1 nkiov 1 00000400:00000200:0.0:1767323635.400582:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323635.400587:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323635.400590:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323635.400592:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323635.400595:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323635.400598:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1527:1527:255:4294967295] 192.168.204.130@tcp LPNI seq info [1527:1527:7:4294967295] 00000400:00000200:0.0:1767323635.400612:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323635.400618:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323635.400623:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab300. 00000800:00000200:0.0:1767323635.400629:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323635.400634:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323635.400637:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab300 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323635.400681:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323635.400684:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323635.400691:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323635.400697:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323635.400705:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323635.400707:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323635.400707:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323635.400713:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323635.400716:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000040:2.0:1767323635.400716:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 11993 usecs (12 jiffies) 02000000:00000001:3.0:1767323635.400723:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323635.400726:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300852237 00000100:00100000:3.0:1767323635.400727:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975845760:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323635.400730:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323635.400738:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323635.400740:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323635.400743:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000010:2.0:1767323635.400748:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a496c0. 02000000:00000010:3.0:1767323635.400749:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5000. 02000000:00000001:3.0:1767323635.400754:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323635.400757:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410013284d0. 00000100:00000001:2.0:1767323635.400760:0:111001:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000400:00000010:3.0:1767323635.400762:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec660. 00000100:00000200:3.0:1767323635.400767:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975845760, portal 10 00000100:00000001:3.0:1767323635.400769:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323635.400770:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300852237 00000100:00000001:3.0:1767323635.400771:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456601472 : -118678252950144 : ffff941010e3ed80) 00000100:00000010:2.0:1767323635.400778:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a497e0. 00000100:00000040:3.0:1767323635.400782:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323635.400784:0:111001:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:2.0:1767323635.400791:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300852237 00000100:00000001:3.0:1767323635.400793:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000010:2.0:1767323635.400796:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49900. 00000100:00000040:3.0:1767323635.400798:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000100:00000001:2.0:1767323635.400803:0:111001:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000400:00000010:3.0:1767323635.400804:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec3b8. 00000100:00000001:2.0:1767323635.400809:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300852237 00000100:00000200:3.0:1767323635.400810:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975845760, offset 0 00000100:00000010:2.0:1767323635.400817:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49120. 00000400:00000200:3.0:1767323635.400818:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:2.0:1767323635.400824:0:111001:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:2.0:1767323635.400829:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323635.400832:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323635.400837:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323635.400841:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000100:00000001:2.0:1767323635.400841:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323635.400848:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323635.400850:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323635.400852:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323635.400855:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000001:2.0:1767323635.400855:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323635.400859:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000400:00000200:3.0:1767323635.400861:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1528:1528:254:4294967295] 192.168.204.130@tcp LPNI seq info [1528:1528:6:4294967295] 00000100:00000001:2.0:1767323635.400864:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323635.400865:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323635.400867:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323635.400872:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323635.400882:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323635.400888:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323635.400893:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3f00. 00000800:00000200:3.0:1767323635.400898:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323635.400902:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323635.400905:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3f00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323635.400923:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323635.400930:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300853486 00000100:00000001:0.0:1767323635.400936:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300852237 00000100:00000001:0.0:1767323635.400945:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300853486 00000100:00000001:0.0:1767323635.400948:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300852237 00000100:00000001:0.0:1767323635.400950:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300853486 00000100:00000001:0.0:1767323635.400952:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300852237 00000100:00000001:0.0:1767323635.400955:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300853486 00000100:00000001:0.0:1767323635.400957:0:111003:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300852237 00000100:00000001:0.0:1767323635.400959:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323635.400961:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323635.400963:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323635.400965:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323635.400970:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323635.400971:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323635.400973:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323635.400974:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323635.400975:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323635.400977:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323635.401439:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323635.401445:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7900. 00000400:00000200:1.0:1767323635.401456:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323635.401463:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323635.401471:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3a18 00000400:00000010:1.0:1767323635.401474:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3a18. 00000100:00000001:1.0:1767323635.401480:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323635.401485:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.401497:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323635.401501:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.401508:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323635.401510:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323635.401597:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323635.401600:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab300. 00000400:00000200:1.0:1767323635.401604:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323635.401608:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323635.401611:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089974c8 00000400:00000010:1.0:1767323635.401613:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089974c8. 00000100:00000001:1.0:1767323635.401615:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323635.401619:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.401627:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323635.401639:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.401645:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323635.401647:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:3.0:1767323635.402986:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323635.402999:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12145 usecs (13 jiffies) 00000100:00000001:3.0:1767323635.403005:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300852240 00000100:00000001:3.0:1767323635.403011:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300853486 00000100:00000001:3.0:1767323635.403013:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300852240 00000100:00000001:3.0:1767323635.403015:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300853486 00000100:00000001:3.0:1767323635.403017:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300852240 00000100:00000001:3.0:1767323635.403020:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300853486 00000100:00000001:3.0:1767323635.403022:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300852240 00000100:00000001:3.0:1767323635.403024:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300853486 00000100:00000001:3.0:1767323635.403027:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323635.403031:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323635.403036:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323635.403040:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323635.403049:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323635.403051:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323635.403054:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323635.403056:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323635.403057:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323635.403060:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323635.403471:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323635.403477:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3f00. 00000400:00000200:0.0:1767323635.403486:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323635.403496:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323635.403504:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec3b8 00000400:00000010:0.0:1767323635.403507:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec3b8. 00000100:00000001:0.0:1767323635.403513:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323635.403530:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323635.403542:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323635.403546:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323635.403553:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323635.403555:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:1.0:1767323635.422474:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422498:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323635.422504:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422507:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323635.422522:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323635.422546:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953f700 00000400:00000200:1.0:1767323635.422557:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x31b9 [1] + 224 00000800:00000001:1.0:1767323635.422568:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422575:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323635.422578:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323635.422583:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323635.422593:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323635.422605:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323635.422617:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323635.422680:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323635.422685:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323635.422729:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323635.422749:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422754:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323635.422756:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422758:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323635.422762:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323635.422768:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f800 00000400:00000200:1.0:1767323635.422775:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31b1 [1] + 224 00000800:00000001:1.0:1767323635.422779:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422783:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323635.422785:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323635.422788:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323635.422799:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323635.422804:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323635.422813:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.422834:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323635.422839:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422843:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323635.422845:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422847:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323635.422850:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323635.422856:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f780 00000400:00000200:1.0:1767323635.422862:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31c1 [1] + 224 00000800:00000001:1.0:1767323635.422866:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422876:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323635.422878:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323635.422881:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323635.422884:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323635.422889:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323635.422897:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323635.422916:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323635.422920:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323635.422923:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323635.422987:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323635.422991:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323635.422999:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323635.423001:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323635.423016:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410013284d0. 00000400:00000200:3.0:1767323635.423021:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec660 00000400:00000010:3.0:1767323635.423023:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec660. 00000100:00000001:3.0:1767323635.423027:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323635.423032:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323635.423041:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323635.423047:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323635.423049:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323635.423052:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323635.423056:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323635.423058:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323635.423061:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323635.423065:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323635.423077:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=87 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323635.423082:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=87 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323635.423085:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323635.423087:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323635.423105:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323635.423110:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323635.423115:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323635.423118:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323635.423120:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323635.423122:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323635.423127:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323635.423135:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323635.423139:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323635.423142:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323635.423147:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323635.423155:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975845760:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323635.423166:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323635.423169:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323635.423173:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3ed80 x1853171975845760/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323635.423181:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323635.423184:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323635.423189:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5000. 02000000:00000001:3.0:1767323635.423193:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323635.423196:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323635.423198:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323635.423209:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323635.423212:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cb00. 02000000:00000001:3.0:1767323635.423216:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323635.423218:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323635.423220:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3ed80. 00000100:00000001:3.0:1767323635.423224:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323635.423225:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323635.423227:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323635.423236:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323635.423238:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323635.423241:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323635.423242:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:0.0:1767323635.423562:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323635.423564:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323635.423567:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716630. 00000400:00000200:0.0:1767323635.423571:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997f68 00000400:00000010:0.0:1767323635.423573:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997f68. 00000100:00000001:0.0:1767323635.423576:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323635.423582:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323635.423590:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323635.423597:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323635.423598:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323635.423600:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323635.423602:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323635.423603:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323635.423605:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323635.423607:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323635.423611:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=88 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323635.423614:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=88 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323635.423616:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323635.423618:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323635.423620:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323635.423622:0:111003:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323635.423624:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323635.423628:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323635.423635:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323635.423637:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323635.423639:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323635.423642:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323635.423650:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975845632:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323635.423655:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323635.423664:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323635.423668:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3fb80 x1853171975845632/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323635.423674:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323635.423677:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323635.423679:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010e19e00. 00000100:00000001:2.0:1767323635.423680:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 02000000:00000001:0.0:1767323635.423684:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000100:00000001:2.0:1767323635.423685:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000020:00000001:0.0:1767323635.423687:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323635.423690:0:111003:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000400:00000001:2.0:1767323635.423691:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000020:00000001:0.0:1767323635.423694:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 00000400:00000001:2.0:1767323635.423695:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 02000000:00000010:0.0:1767323635.423697:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cf00. 00000400:00000010:2.0:1767323635.423700:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35d10. 02000000:00000001:0.0:1767323635.423702:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323635.423705:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000400:00000200:2.0:1767323635.423707:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3330 00000100:00000010:0.0:1767323635.423707:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3fb80. 00000400:00000010:2.0:1767323635.423712:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3330. 00000100:00000001:0.0:1767323635.423713:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323635.423717:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323635.423718:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000001:0.0:1767323635.423720:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323635.423726:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323635.423728:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323635.423730:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323635.423732:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:2.0:1767323635.423738:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323635.423751:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323635.423767:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323635.423769:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323635.423771:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323635.423773:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323635.423774:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323635.423776:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323635.423778:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323635.423785:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=87 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323635.423788:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=87 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323635.423790:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323635.423791:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323635.423793:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323635.423798:0:111001:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323635.423804:0:111001:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323635.423807:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323635.423809:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323635.423810:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323635.423811:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323635.423815:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323635.423821:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323635.423823:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323635.423824:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323635.423827:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323635.423836:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975845888:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323635.423841:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323635.423842:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323635.423846:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3d180 x1853171975845888/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323651 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323635.423858:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323635.423860:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323635.423862:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fc00. 02000000:00000001:2.0:1767323635.423865:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323635.423867:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323635.423868:0:111001:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323635.423870:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323635.423872:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c100. 02000000:00000001:2.0:1767323635.423874:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323635.423875:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323635.423877:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d180. 00000100:00000001:2.0:1767323635.423880:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323635.423881:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323635.423883:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323635.423888:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323635.423890:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323635.423892:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323635.423894:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323635.975560:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323635.975573:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323635.975582:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323635.975583:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323635.979101:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323635.979113:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323635.979121:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323636.679567:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300853486, at 4300853504 00000100:00000040:3.0:1767323636.679581:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300853486, at 4300853504 00000100:00000010:1.0:1767323636.679592:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a497e0. 00000100:00000010:3.0:1767323636.679609:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49120. 00000100:00000040:2.0:1767323636.679622:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300853486, at 4300853504 00000100:00000010:2.0:1767323636.679629:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49900. 00000100:00000040:0.0:1767323636.680786:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300853486, at 4300853505 00000100:00000010:0.0:1767323636.680800:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a496c0. 00010000:00000001:0.0:1767323636.999541:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323636.999553:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323636.999562:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323636.999564:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323636.999782:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323636.999786:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323636.999789:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323638.023884:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323638.023902:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323638.023905:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323638.023909:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323638.023918:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323638.023921:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323638.023953:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323638.023956:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323638.023962:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323638.023963:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323638.026959:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323638.026969:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323638.026977:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323639.048446:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323639.048457:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323639.048465:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323639.048467:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323639.048655:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323639.048660:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323639.048664:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323640.071847:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323640.072164:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323640.072171:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323640.072176:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323640.072178:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323640.072182:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323640.072185:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323640.072187:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323640.072190:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323640.072191:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323640.072194:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323640.072196:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323640.072336:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323640.072339:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323640.072343:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323640.519658:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323640.519670:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323640.520066:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6680. 00000020:00000040:0.0:1767323640.520073:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323640.520078:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323640.520082:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323640.520086:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323640.520093:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abe00. 00000100:00000001:0.0:1767323640.520100:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.520268:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323640.520279:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323640.520283:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.520288:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b3324cef] to pc [ptlrpcd_00_01+1] req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.520339:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.520343:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323640.520346:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323640.520350:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4000. 00000020:00000040:0.0:1767323640.520353:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323640.520355:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 00000100:00000001:1.0:1767323640.520357:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 02000000:00000001:0.0:1767323640.520357:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323640.520361:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323640.520362:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323640.520366:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 02000000:00000010:0.0:1767323640.520367:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab400. 00000100:00000001:0.0:1767323640.520372:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323640.520374:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323640.520379:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323640.520415:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323640.520418:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.520423:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000551ca353] to pc [ptlrpcd_00_02+2] req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.520440:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.520443:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323640.520447:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323640.520449:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6300. 00000020:00000040:0.0:1767323640.520453:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323640.520455:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323640.520456:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323640.520458:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323640.520461:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abd00. 00000100:00000001:0.0:1767323640.520463:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.520467:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323640.520474:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323640.520483:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.520487:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009ac1c142] to pc [ptlrpcd_00_03+3] req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.520495:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.520497:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323640.520501:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323640.520504:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323640.520506:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323640.520511:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6195) 00000100:00000001:0.0:1767323640.520523:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323640.520525:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323640.520527:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323640.520532:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.520538:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323640.520541:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323640.520544:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323640.520547:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323640.520549:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323640.520553:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975846144:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323640.520557:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323640.520562:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323640.520565:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323640.520567:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323640.520571:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102030fa00. 02000000:00000001:0.0:1767323640.520573:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323640.520579:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716630. 00000400:00000010:0.0:1767323640.520586:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997f68. 00000100:00000200:0.0:1767323640.520593:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975846144, portal 10 00000100:00000001:0.0:1767323640.520596:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323640.520605:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470909440 : -118678238642176 : ffff941011be4000) 00000100:00000040:0.0:1767323640.520614:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.520625:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:1.0:1767323640.520627:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000040:0.0:1767323640.520630:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000100:00000001:1.0:1767323640.520631:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323640.520636:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000400:00000010:0.0:1767323640.520636:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089974c8. 02000000:00000001:1.0:1767323640.520640:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000200:0.0:1767323640.520642:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975846144, offset 0 02000000:00000001:1.0:1767323640.520644:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323640.520651:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975846016:192.168.204.130@tcp:400:kworker.0 00000400:00000200:0.0:1767323640.520652:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:1.0:1767323640.520658:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323640.520661:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323640.520662:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323640.520664:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323640.520668:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010711a00. 02000000:00000001:1.0:1767323640.520671:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1767323640.520671:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000010:1.0:1767323640.520678:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156528. 00000400:00000010:1.0:1767323640.520682:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890aa18. 00000100:00000200:1.0:1767323640.520685:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975846016, portal 25 00000100:00000001:1.0:1767323640.520688:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323640.520689:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470919296 : -118678238632320 : ffff941011be6680) 00000400:00000200:0.0:1767323640.520691:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000040:1.0:1767323640.520697:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:0.0:1767323640.520699:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323640.520706:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000100:00000001:1.0:1767323640.520711:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000400:00000200:0.0:1767323640.520713:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000040:1.0:1767323640.520717:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323640.520720:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a330. 00000400:00000200:0.0:1767323640.520721:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1529:1529:256:4294967295] 192.168.204.130@tcp LPNI seq info [1529:1529:8:4294967295] 00000100:00000200:1.0:1767323640.520723:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975846016, offset 0 00000400:00000200:1.0:1767323640.520733:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:3.0:1767323640.520790:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323640.520794:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323640.520811:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323640.520813:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323640.520815:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323640.520822:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323640.520899:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323640.520901:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323640.520904:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323640.520906:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323640.521343:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323640.521354:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975846272:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323640.521358:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323640.521361:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323640.521363:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323640.521365:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323640.521368:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5400. 02000000:00000001:3.0:1767323640.521370:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323640.521374:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410013284d0. 00000400:00000010:3.0:1767323640.521397:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec660. 00000100:00000200:3.0:1767323640.521402:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975846272, portal 10 00000100:00000001:3.0:1767323640.521404:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323640.521405:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470918400 : -118678238633216 : ffff941011be6300) 00000100:00000040:3.0:1767323640.521412:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323640.521419:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323640.521421:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323640.521424:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecaa0. 00000100:00000200:3.0:1767323640.521426:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975846272, offset 0 00000400:00000200:3.0:1767323640.521431:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323640.521518:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323640.521526:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323640.521531:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab300. 00000800:00000200:0.0:1767323640.521538:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323640.521545:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323640.521549:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab300 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323640.521561:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.521565:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12806 usecs (13 jiffies) 00000100:00000001:0.0:1767323640.521569:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300857359 00000100:00000010:0.0:1767323640.521574:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2a20. 00000100:00000001:0.0:1767323640.521581:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:0.0:1767323640.521588:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300857359 00000100:00000010:0.0:1767323640.521591:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2120. 00000100:00000001:0.0:1767323640.521593:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:0.0:1767323640.521596:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300857359 00000100:00000010:0.0:1767323640.521605:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2660. 00000100:00000001:0.0:1767323640.521608:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:0.0:1767323640.521611:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300857359 00000100:00000010:0.0:1767323640.521614:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba20c0. 00000100:00000001:0.0:1767323640.521617:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:0.0:1767323640.521620:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323640.521623:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.521626:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.521628:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323640.521636:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323640.521638:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323640.521640:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323640.521641:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323640.521642:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.521644:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323640.521793:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323640.521798:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab300. 00000400:00000200:0.0:1767323640.521803:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323640.521809:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323640.521838:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323640.521853:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323640.521856:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323640.521858:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323640.522196:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323640.522200:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1530:1530:255:4294967295] 192.168.204.130@tcp LPNI seq info [1530:1530:7:4294967295] 00000400:00000200:1.0:1767323640.522211:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323640.522225:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323640.522229:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c600. 00000800:00000200:1.0:1767323640.522233:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323640.522238:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323640.522241:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323640.522244:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323640.522248:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300858607 00000100:00000001:1.0:1767323640.522254:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300857359 00000100:00000001:1.0:1767323640.522258:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300858607 00000400:00000200:3.0:1767323640.522262:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000100:00000001:1.0:1767323640.522266:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300857359 00000400:00000200:3.0:1767323640.522267:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000001:1.0:1767323640.522272:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300858607 00000400:00000200:3.0:1767323640.522273:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000100:00000001:1.0:1767323640.522278:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300857359 00000400:00000200:3.0:1767323640.522279:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000100:00000001:1.0:1767323640.522283:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300858607 00000100:00000001:1.0:1767323640.522285:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300857359 00000400:00000200:3.0:1767323640.522290:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000001:1.0:1767323640.522291:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323640.522296:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323640.522298:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1531:1531:254:4294967295] 192.168.204.130@tcp LPNI seq info [1531:1531:6:4294967295] 00000100:00000001:1.0:1767323640.522300:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323640.522305:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323640.522311:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000400:00000200:3.0:1767323640.522313:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:1.0:1767323640.522314:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000800:00000200:3.0:1767323640.522330:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323640.522334:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3600. 00000800:00000200:3.0:1767323640.522339:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323640.522343:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323640.522346:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323640.522349:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323640.522353:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 12870 usecs (13 jiffies) 00000100:00000001:3.0:1767323640.522355:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300857359 00000100:00000001:3.0:1767323640.522358:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300858607 00000100:00000001:3.0:1767323640.522360:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300857359 00000100:00000001:3.0:1767323640.522362:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300858607 00000100:00000001:3.0:1767323640.522364:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300857359 00000100:00000001:3.0:1767323640.522366:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300858607 00000100:00000001:3.0:1767323640.522368:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300857359 00000100:00000001:3.0:1767323640.522370:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300858607 00000100:00000001:3.0:1767323640.522372:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323640.522374:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323640.522376:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323640.522378:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323640.522401:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323640.522403:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323640.522406:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323640.522407:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323640.522408:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323640.522410:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323640.522494:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323640.522496:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323640.522498:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323640.522500:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:0.0:1767323640.522587:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089974c8 00000400:00000010:0.0:1767323640.522590:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089974c8. 00000100:00000001:0.0:1767323640.522594:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323640.522600:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.522611:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323640.522614:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.522622:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.522624:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323640.522640:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323640.522643:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c600. 00000400:00000200:0.0:1767323640.522645:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323640.522648:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323640.522656:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a330 00000400:00000010:0.0:1767323640.522658:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a330. 00000100:00000001:0.0:1767323640.522661:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323640.522666:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.522793:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323640.522798:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.522805:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.522806:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323640.523049:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323640.523052:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3600. 00000400:00000200:0.0:1767323640.523057:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323640.523061:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323640.523064:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecaa0 00000400:00000010:0.0:1767323640.523066:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecaa0. 00000100:00000001:0.0:1767323640.523068:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323640.523072:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.523080:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323640.523083:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.523089:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.523091:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:0.0:1767323640.528064:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323640.528081:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323640.528085:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323640.528088:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323640.528104:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323640.528122:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f900 00000400:00000200:0.0:1767323640.528130:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31c9 [1] + 224 00000800:00000001:0.0:1767323640.528137:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323640.528157:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323640.528161:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323640.528166:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323640.528173:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323640.528182:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323640.528193:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.528225:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323640.528234:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323640.528237:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323640.530169:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323640.530189:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323640.530193:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323640.530195:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323640.530204:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323640.530230:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953f880 00000400:00000200:3.0:1767323640.530238:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x31d1 [1] + 224 00000800:00000001:3.0:1767323640.530244:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323640.530252:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323640.530255:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323640.530258:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323640.530263:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323640.530270:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323640.530279:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323640.530298:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323640.530305:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323640.530308:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323640.530434:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323640.530439:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323640.530446:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323640.530448:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323640.530451:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716630. 00000400:00000200:1.0:1767323640.530465:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997f68 00000400:00000010:1.0:1767323640.530468:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997f68. 00000100:00000001:1.0:1767323640.530471:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323640.530477:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323640.530488:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323640.530495:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323640.530497:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323640.530500:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323640.530504:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323640.530506:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323640.530509:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323640.530512:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323640.530522:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=92 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323640.530526:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=92 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323640.530529:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323640.530530:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323640.530533:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323640.530537:0:111003:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323640.530540:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323640.530542:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323640.530544:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323640.530545:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323640.530549:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323640.530556:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323640.530559:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323640.530561:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323640.530565:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323640.530578:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975846144:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323640.530583:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323640.530586:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323640.530589:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4000 x1853171975846144/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323640.530596:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323640.530598:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323640.530602:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102030fa00. 02000000:00000001:1.0:1767323640.530605:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323640.530607:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323640.530609:0:111003:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:1.0:1767323640.530611:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323640.530613:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab400. 02000000:00000001:1.0:1767323640.530616:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323640.530618:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323640.530620:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4000. 00000100:00000001:1.0:1767323640.530623:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323640.530624:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323640.530627:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323640.530634:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323640.530636:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323640.530638:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323640.530640:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.531045:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323640.531047:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1767323640.531050:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323640.531052:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323640.531053:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156528. 00000400:00000200:0.0:1767323640.531057:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890aa18 00000400:00000010:0.0:1767323640.531058:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890aa18. 00000100:00000001:0.0:1767323640.531060:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323640.531064:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323640.531071:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.531075:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323640.531076:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323640.531077:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323640.531078:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323640.531079:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323640.531080:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323640.531081:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323640.531084:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=93 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323640.531086:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=93 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323640.531087:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323640.531088:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323640.531095:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323640.531096:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.531098:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323640.531100:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.531104:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323640.531106:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323640.531107:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323640.531109:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323640.531113:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975846016:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323640.531115:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323640.531117:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323640.531118:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be6680 x1853171975846016/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.531122:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323640.531123:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323640.531124:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010711a00. 02000000:00000001:0.0:1767323640.531125:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323640.531126:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323640.531127:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:0.0:1767323640.531128:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323640.531129:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abe00. 02000000:00000001:0.0:1767323640.531131:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323640.531131:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323640.531133:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6680. 00000100:00000001:0.0:1767323640.531134:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323640.531135:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323640.531136:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323640.531139:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323640.531140:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323640.531141:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323640.531143:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323640.541448:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323640.541463:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323640.541466:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323640.541469:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323640.541480:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323640.541496:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953f980 00000400:00000200:0.0:1767323640.541504:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31d9 [1] + 224 00000800:00000001:0.0:1767323640.541512:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323640.541521:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323640.541524:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323640.541528:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323640.541534:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323640.541541:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323640.541549:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323640.541564:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323640.541571:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323640.541573:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323640.541627:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323640.541631:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323640.541647:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323640.541649:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323640.541653:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410013284d0. 00000400:00000200:3.0:1767323640.541657:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec660 00000400:00000010:3.0:1767323640.541660:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec660. 00000100:00000001:3.0:1767323640.541663:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323640.541668:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323640.541677:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323640.541684:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323640.541685:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323640.541701:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323640.541703:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323640.541706:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323640.541708:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323640.541710:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323640.541718:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=92 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323640.541722:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=92 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323640.541725:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323640.541727:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323640.541729:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1767323640.541734:0:111004:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1767323640.541740:0:111004:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323640.541744:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323640.541746:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323640.541748:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323640.541750:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323640.541754:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323640.541760:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323640.541762:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323640.541764:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323640.541768:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323640.541775:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975846272:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323640.541780:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323640.541783:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323640.541786:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be6300 x1853171975846272/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323656 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323640.541791:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323640.541793:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323640.541813:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5400. 02000000:00000001:3.0:1767323640.541818:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323640.541821:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323640.541822:0:111004:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323640.541825:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323640.541828:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abd00. 02000000:00000001:3.0:1767323640.541832:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323640.541833:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323640.541836:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6300. 00000100:00000001:3.0:1767323640.541839:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323640.541840:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323640.541843:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323640.541859:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323640.541861:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323640.541863:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323640.541866:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323641.095555:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323641.095565:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323641.095572:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323641.095574:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323641.095704:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323641.095710:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323641.095713:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323641.799613:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300858607, at 4300858624 00000100:00000010:3.0:1767323641.799636:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba20c0. 00000100:00000040:0.0:1767323641.799743:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300858607, at 4300858624 00000100:00000010:0.0:1767323641.799751:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2a20. 00000100:00000040:1.0:1767323641.799881:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300858607, at 4300858624 00000100:00000010:1.0:1767323641.799888:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2120. 00000100:00000040:2.0:1767323641.803459:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300858607, at 4300858628 00000100:00000010:2.0:1767323641.803474:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2660. 00010000:00000001:0.0:1767323642.119572:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323642.119583:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323642.119590:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323642.119592:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323642.119807:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323642.119811:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323642.119815:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323643.143624:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323643.143635:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323643.143642:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323643.143643:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323643.143808:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323643.143818:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323643.143822:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323644.167778:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323644.167789:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323644.167797:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323644.167799:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323644.168240:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323644.168245:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323644.168249:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323645.191562:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323645.191573:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323645.191581:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323645.191583:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323645.191775:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323645.191780:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323645.191785:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323645.639519:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323645.639535:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323645.639544:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6680. 00000020:00000040:0.0:1767323645.639551:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323645.639556:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323645.639560:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323645.639567:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323645.639577:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abe00. 00000100:00000001:0.0:1767323645.639585:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639600:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323645.639613:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323645.639618:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639625:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b3324cef] to pc [ptlrpcd_00_00+0] req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.639663:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639666:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323645.639670:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323645.639673:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4a80. 00000020:00000040:0.0:1767323645.639675:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323645.639678:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323645.639679:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323645.639681:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323645.639684:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab300. 00000100:00000001:0.0:1767323645.639687:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639704:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323645.639711:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323645.639713:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639717:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ddad287f] to pc [ptlrpcd_00_01+1] req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.639736:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639738:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323645.639742:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323645.639747:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6300. 00000020:00000040:0.0:1767323645.639750:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323645.639752:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323645.639754:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323645.639756:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323645.639760:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab900. 00000100:00000001:0.0:1767323645.639763:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639768:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323645.639775:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323645.639777:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639781:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009ac1c142] to pc [ptlrpcd_00_02+2] req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.639803:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.639806:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323645.639810:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323645.639813:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323645.639816:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323645.639823:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6200) 00000100:00000001:0.0:1767323645.639846:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323645.639850:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323645.639853:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323645.639860:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.639868:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323645.639871:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323645.639875:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323645.639879:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323645.639882:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323645.639886:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975846656:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323645.639891:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323645.639897:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323645.639901:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323645.639904:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323645.639909:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94102030ea00. 02000000:00000001:0.0:1767323645.639911:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323645.639918:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716f78. 00000400:00000010:0.0:1767323645.639928:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089974c8. 00000100:00000200:0.0:1767323645.639937:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975846656, portal 10 00000100:00000001:0.0:1767323645.639939:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323645.639941:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470918400 : -118678238633216 : ffff941011be6300) 00000100:00000040:0.0:1767323645.639948:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.639956:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323645.639959:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323645.639962:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997880. 00000100:00000200:0.0:1767323645.639966:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975846656, offset 0 00000400:00000200:0.0:1767323645.639974:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323645.639990:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323645.639997:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323645.640003:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323645.640007:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323645.640015:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323645.640021:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1532:1532:256:4294967295] 192.168.204.130@tcp LPNI seq info [1532:1532:8:4294967295] 00000400:00000200:0.0:1767323645.640035:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323645.640042:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323645.640048:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012abc00. 00000800:00000200:0.0:1767323645.640055:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323645.640065:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323645.640070:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012abc00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323645.640083:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323645.640088:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 13518 usecs (14 jiffies) 00000100:00000001:0.0:1767323645.640092:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300862478 00000100:00000010:0.0:1767323645.640097:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2a20. 00000100:00000001:0.0:1767323645.640106:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:0.0:1767323645.640113:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300862478 00000100:00000010:0.0:1767323645.640117:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2f00. 00000100:00000001:0.0:1767323645.640132:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:0.0:1767323645.640135:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300862478 00000100:00000010:0.0:1767323645.640139:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2ae0. 00000100:00000001:0.0:1767323645.640142:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:0.0:1767323645.640145:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300862478 00000100:00000010:0.0:1767323645.640149:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2300. 00000100:00000001:0.0:1767323645.640152:0:111003:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:0.0:1767323645.640155:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323645.640159:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323645.640162:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323645.640165:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323645.640175:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323645.640177:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323645.640180:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323645.640186:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323645.640188:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323645.640191:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323645.640200:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323645.640202:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323645.640330:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323645.640335:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012abc00. 00000400:00000200:0.0:1767323645.640340:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323645.640346:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323645.640352:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997880 00000400:00000010:0.0:1767323645.640354:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997880. 00000100:00000001:0.0:1767323645.640358:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323645.640371:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.640380:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323645.640407:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.640414:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323645.640415:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:3.0:1767323645.640484:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323645.640488:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323645.640489:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323645.640495:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.640502:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323645.640503:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323645.640505:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323645.640507:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323645.640509:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323645.640512:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975846400:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323645.640515:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323645.640517:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323645.640519:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323645.640521:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323645.640525:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5e00. 02000000:00000001:3.0:1767323645.640527:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323645.640537:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410013284d0. 00000400:00000010:3.0:1767323645.640542:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec660. 00000100:00000200:3.0:1767323645.640545:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975846400, portal 25 00000100:00000001:3.0:1767323645.640547:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323645.640548:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470919296 : -118678238632320 : ffff941011be6680) 00000100:00000040:3.0:1767323645.640553:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.640560:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323645.640562:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323645.640564:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecbb0. 00000100:00000200:3.0:1767323645.640568:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975846400, offset 0 00000400:00000200:3.0:1767323645.640573:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323645.640578:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323645.640581:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323645.640584:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323645.640586:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323645.640588:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323645.640592:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1533:1533:256:4294967295] 192.168.204.130@tcp LPNI seq info [1533:1533:8:4294967295] 00000400:00000200:3.0:1767323645.640600:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323645.640605:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323645.640610:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3200. 00000800:00000200:3.0:1767323645.640613:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323645.640618:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323645.640621:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3200 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323645.640642:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.640646:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300863726 00000100:00000001:3.0:1767323645.640652:0:111001:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300862478 00000100:00000001:3.0:1767323645.640656:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300863726 00000100:00000001:3.0:1767323645.640658:0:111001:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300862478 00000100:00000001:3.0:1767323645.640661:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300863726 00000100:00000001:3.0:1767323645.640670:0:111001:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300862478 00000100:00000001:3.0:1767323645.640673:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300863726 00000100:00000001:3.0:1767323645.640676:0:111001:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300862478 00000100:00000001:3.0:1767323645.640678:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323645.640681:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.640683:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.640685:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.640689:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323645.640691:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323645.640693:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323645.640694:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323645.640695:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323645.640698:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000001:3.0:1767323645.640700:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.640701:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323645.640703:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.640704:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323645.640705:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323645.640707:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323645.640712:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.640718:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323645.640719:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323645.640722:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323645.640724:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323645.640726:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323645.640729:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975846528:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323645.640732:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323645.640735:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323645.640736:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323645.640739:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323645.640741:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b4e00. 02000000:00000001:3.0:1767323645.640743:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323645.640746:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323645.640754:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec000. 00000100:00000200:3.0:1767323645.640756:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975846528, portal 10 00000100:00000001:3.0:1767323645.640759:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323645.640760:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470912128 : -118678238639488 : ffff941011be4a80) 00000100:00000040:3.0:1767323645.640766:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.640772:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323645.640774:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323645.640776:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec7f8. 00000100:00000200:3.0:1767323645.640778:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975846528, offset 0 00000400:00000200:3.0:1767323645.640782:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323645.640787:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323645.640790:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323645.640792:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323645.640795:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323645.640797:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323645.640800:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1534:1534:255:4294967295] 192.168.204.130@tcp LPNI seq info [1534:1534:7:4294967295] 00000400:00000200:3.0:1767323645.640806:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323645.640810:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323645.640814:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3e00. 00000800:00000200:3.0:1767323645.640818:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323645.640822:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323645.640824:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3e00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323645.640827:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323645.640830:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12797 usecs (13 jiffies) 00000100:00000001:3.0:1767323645.640833:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300862478 00000100:00000001:3.0:1767323645.640835:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300863726 00000100:00000001:3.0:1767323645.640837:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300862478 00000100:00000001:3.0:1767323645.640839:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300863726 00000100:00000001:3.0:1767323645.640847:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300862478 00000100:00000001:3.0:1767323645.640849:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300863726 00000100:00000001:3.0:1767323645.640851:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300862478 00000100:00000001:3.0:1767323645.640854:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300863726 00000100:00000001:3.0:1767323645.640856:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323645.640858:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.640861:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.640863:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323645.641128:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323645.641132:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3200. 00000400:00000200:0.0:1767323645.641138:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323645.641143:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323645.641146:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecbb0 00000400:00000010:0.0:1767323645.641148:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecbb0. 00000100:00000001:0.0:1767323645.641151:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323645.641156:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.641164:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323645.641166:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.641172:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323645.641173:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323645.641207:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323645.641215:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3e00. 00000400:00000200:0.0:1767323645.641218:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323645.641221:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323645.641225:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec7f8 00000400:00000010:0.0:1767323645.641226:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec7f8. 00000100:00000001:0.0:1767323645.641229:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323645.641232:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.641240:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323645.641243:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.641249:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323645.641251:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:2.0:1767323645.646232:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323645.646245:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323645.648170:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323645.648196:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323645.648201:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323645.648204:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323645.648218:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323645.648240:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953fb00 00000400:00000200:0.0:1767323645.648252:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31e1 [1] + 224 00000800:00000001:0.0:1767323645.648262:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323645.648268:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323645.648271:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323645.648276:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323645.648286:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323645.648297:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323645.648309:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323645.648333:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323645.648344:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323645.648523:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323645.648525:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323645.648528:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323645.648532:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323645.648539:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953fa80 00000400:00000200:0.0:1767323645.648545:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31f1 [1] + 224 00000800:00000001:0.0:1767323645.648549:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323645.648556:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323645.648558:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323645.648561:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323645.648565:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323645.648570:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323645.648578:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.648626:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323645.648631:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323645.653315:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323645.653349:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323645.653363:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323645.654073:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323645.654080:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323645.654093:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323645.654095:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323645.654101:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716f78. 00000400:00000200:2.0:1767323645.654110:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089974c8 00000400:00000010:2.0:1767323645.654113:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089974c8. 00000100:00000001:2.0:1767323645.654128:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323645.654143:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323645.654185:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323645.654192:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323645.654195:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323645.654198:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323645.654202:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323645.654205:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323645.654208:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323645.654211:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323645.654223:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=97 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323645.654228:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=97 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323645.654231:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323645.654233:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323645.654237:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323645.654244:0:111003:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323645.654251:0:111003:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323645.654256:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323645.654258:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323645.654260:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323645.654262:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323645.654266:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323645.654274:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323645.654278:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323645.654281:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323645.654285:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323645.654293:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975846656:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323645.654307:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323645.654310:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323645.654314:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be6300 x1853171975846656/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323645.654320:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323645.654324:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323645.654328:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94102030ea00. 02000000:00000001:2.0:1767323645.654331:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323645.654334:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323645.654337:0:111003:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323645.654339:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323645.654342:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab900. 02000000:00000001:2.0:1767323645.654347:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323645.654349:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323645.654351:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6300. 00000100:00000001:2.0:1767323645.654356:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323645.654357:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323645.654456:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323645.654468:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323645.654470:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323645.654473:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323645.654475:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:3.0:1767323645.655037:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323645.655040:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323645.655044:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:3.0:1767323645.655050:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec000 00000400:00000010:3.0:1767323645.655052:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec000. 00000100:00000001:3.0:1767323645.655056:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323645.655063:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323645.655074:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.655080:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323645.655082:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.655084:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323645.655086:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323645.655088:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323645.655091:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323645.655093:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323645.655100:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=97 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323645.655104:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=97 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323645.655106:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323645.655108:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323645.655111:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323645.655113:0:111001:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.655137:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323645.655139:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323645.655140:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323645.655142:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323645.655147:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.655154:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323645.655157:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323645.655158:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323645.655161:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323645.655170:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975846528:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323645.655176:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.655178:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323645.655180:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4a80 x1853171975846528/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.655187:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323645.655189:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323645.655192:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b4e00. 02000000:00000001:3.0:1767323645.655195:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323645.655198:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323645.655200:0:111001:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323645.655202:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323645.655204:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab300. 02000000:00000001:3.0:1767323645.655207:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323645.655208:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323645.655211:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4a80. 00000100:00000001:3.0:1767323645.655214:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323645.655215:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.655218:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.655220:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323645.655222:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323645.655224:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.655230:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:2.0:1767323645.655303:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323645.655320:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1767323645.655322:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323645.655325:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323645.655334:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323645.655353:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953fa00 00000400:00000200:2.0:1767323645.655375:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x31e9 [1] + 224 00000800:00000001:2.0:1767323645.655406:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323645.655416:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323645.655420:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323645.655425:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:2.0:1767323645.655432:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323645.655444:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323645.655454:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323645.655474:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1767323645.655485:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323645.655489:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.655618:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323645.655621:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323645.655625:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323645.655626:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323645.655628:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410013284d0. 00000400:00000200:3.0:1767323645.655632:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec660 00000400:00000010:3.0:1767323645.655635:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec660. 00000100:00000001:3.0:1767323645.655638:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323645.655642:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323645.655662:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.655669:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323645.655671:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.655672:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323645.655674:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323645.655676:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323645.655678:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323645.655680:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323645.655684:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=98 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323645.655687:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=98 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323645.655690:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323645.655691:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323645.655693:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323645.655695:0:111001:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.655697:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323645.655701:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.655706:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323645.655708:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323645.655710:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323645.655714:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323645.655733:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975846400:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323645.655737:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.655739:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323645.655742:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be6680 x1853171975846400/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323661 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323645.655749:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323645.655750:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323645.655753:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5e00. 02000000:00000001:3.0:1767323645.655756:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323645.655757:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323645.655759:0:111001:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:3.0:1767323645.655761:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323645.655763:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abe00. 02000000:00000001:3.0:1767323645.655765:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323645.655766:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323645.655768:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6680. 00000100:00000001:3.0:1767323645.655770:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323645.655771:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.655773:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323645.655781:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323645.655782:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323645.655784:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323645.655787:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323646.218534:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323646.218546:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323646.218554:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323646.218556:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323646.218802:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323646.218806:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323646.218810:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323646.919470:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300863726, at 4300863744 00000100:00000040:3.0:1767323646.919478:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300863726, at 4300863744 00000100:00000010:1.0:1767323646.919494:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2f00. 00000100:00000010:3.0:1767323646.919499:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2300. 00000100:00000040:0.0:1767323646.919588:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300863726, at 4300863744 00000100:00000010:0.0:1767323646.919596:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2a20. 00000100:00000040:2.0:1767323646.919912:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300863726, at 4300863744 00000100:00000010:2.0:1767323646.919919:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2ae0. 00010000:00000001:0.0:1767323647.240796:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323647.240806:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323647.240814:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323647.240815:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323647.241929:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323647.241936:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323647.241940:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323648.263850:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323648.263863:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323648.263865:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323648.263869:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323648.263877:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323648.263906:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323648.263909:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323648.263912:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323648.263917:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323648.263919:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323648.264051:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323648.264055:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323648.264064:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323649.287551:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323649.287557:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323649.287563:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323649.287564:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323649.287665:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323649.287668:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323649.287670:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323650.311550:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323650.311559:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323650.311567:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323650.311571:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323650.311574:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323650.311580:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323650.311583:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323650.311585:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323650.311589:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323650.311592:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323650.311594:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323650.311596:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323650.311847:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323650.311852:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323650.311855:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323650.759555:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323650.759570:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323650.759586:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4000. 00000020:00000040:0.0:1767323650.759595:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323650.759600:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323650.759604:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323650.759612:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323650.759623:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abc00. 00000100:00000001:0.0:1767323650.759632:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323650.759647:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323650.759661:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323650.759667:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323650.759676:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000551ca353] to pc [ptlrpcd_00_03+3] req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.759753:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323650.759757:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323650.759761:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323650.759765:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4380. 00000020:00000040:0.0:1767323650.759768:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323650.759770:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323650.759772:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323650.759774:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323650.759777:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abb00. 00000100:00000001:0.0:1767323650.759781:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323650.759785:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323650.759793:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323650.759796:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323650.759800:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000053f49053] to pc [ptlrpcd_00_00+0] req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.759832:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323650.759835:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323650.759838:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323650.759842:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be4700. 00000020:00000040:0.0:1767323650.759845:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323650.759847:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323650.759848:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323650.759850:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323650.759854:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab700. 00000100:00000001:0.0:1767323650.759857:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323650.759862:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323650.759869:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323650.759877:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323650.759882:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a8eec513] to pc [ptlrpcd_00_01+1] req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323650.759884:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323650.759890:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323650.759890:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323650.759893:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323650.759893:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323650.759897:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323650.759899:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323650.759900:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323650.759904:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000001:1.0:1767323650.759908:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000040:0.0:1767323650.759909:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6205) 00000100:00000001:1.0:1767323650.759910:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323650.759915:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323650.759918:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323650.759921:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323650.759924:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975846912:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323650.759930:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323650.759937:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323650.759940:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323650.759943:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323650.759949:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010711000. 02000000:00000001:1.0:1767323650.759951:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323650.759959:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410181563c8. 00000400:00000010:1.0:1767323650.759968:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a908. 00000100:00000200:1.0:1767323650.759977:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975846912, portal 10 00000100:00000001:1.0:1767323650.759980:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323650.759981:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470910336 : -118678238641280 : ffff941011be4380) 00000100:00000040:1.0:1767323650.759990:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323650.760001:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:2.0:1767323650.760006:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:2.0:1767323650.760009:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323650.760018:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323650.760018:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:2.0:1767323650.760020:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323650.760022:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000100:00000001:2.0:1767323650.760023:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323650.760034:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323650.760036:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000400:00000010:1.0:1767323650.760036:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890a5d8. 00000100:00000200:1.0:1767323650.760040:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975846912, offset 0 00000100:00000040:2.0:1767323650.760042:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1767323650.760048:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:2.0:1767323650.760049:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323650.760050:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323650.760052:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323650.760054:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323650.760056:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323650.760058:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975846784:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323650.760061:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323650.760064:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000400:00000200:1.0:1767323650.760065:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 02000000:00000001:2.0:1767323650.760066:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323650.760067:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323650.760071:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fa00. 00000400:00000200:1.0:1767323650.760072:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 02000000:00000001:2.0:1767323650.760073:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323650.760077:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35d10. 00000400:00000200:1.0:1767323650.760078:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000010:2.0:1767323650.760082:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3330. 00000400:00000200:1.0:1767323650.760082:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323650.760085:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000200:2.0:1767323650.760090:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975846784, portal 25 00000400:00000200:1.0:1767323650.760090:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1535:1535:256:4294967295] 192.168.204.130@tcp LPNI seq info [1535:1535:8:4294967295] 00000100:00000001:2.0:1767323650.760092:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323650.760094:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470909440 : -118678238642176 : ffff941011be4000) 00000100:00000040:2.0:1767323650.760099:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:1.0:1767323650.760103:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:2.0:1767323650.760105:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323650.760108:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323650.760110:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc35d8. 00000800:00000200:1.0:1767323650.760111:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000100:00000200:2.0:1767323650.760112:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975846784, offset 0 00000400:00000200:2.0:1767323650.760116:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323650.760121:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323650.760123:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323650.760126:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323650.760128:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000800:00000010:1.0:1767323650.760128:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c800. 00000400:00000200:2.0:1767323650.760130:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323650.760133:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1536:1536:255:4294967295] 192.168.204.130@tcp LPNI seq info [1536:1536:7:4294967295] 00000800:00000200:1.0:1767323650.760136:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000400:00000200:2.0:1767323650.760140:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323650.760143:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000200:1.0:1767323650.760146:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000010:2.0:1767323650.760147:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7100. 00000800:00000200:2.0:1767323650.760151:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323650.760154:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323650.760159:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7100 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323650.760183:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.760189:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300868845 00000100:00000010:2.0:1767323650.760194:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a494e0. 00000100:00000001:2.0:1767323650.760202:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:2.0:1767323650.760210:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300868845 00000100:00000010:2.0:1767323650.760214:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49300. 00000100:00000001:2.0:1767323650.760217:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:2.0:1767323650.760220:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300868845 00000100:00000010:2.0:1767323650.760228:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49660. 00000100:00000001:2.0:1767323650.760231:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:2.0:1767323650.760235:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300868845 00000100:00000010:2.0:1767323650.760238:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49900. 00000100:00000001:2.0:1767323650.760241:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:2.0:1767323650.760244:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323650.760247:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.760251:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.760253:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.760265:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323650.760267:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323650.760269:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323650.760274:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323650.760281:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323650.760282:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323650.760285:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323650.760287:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323650.760289:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323650.760291:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975847040:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323650.760295:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323650.760308:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323650.760310:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323650.760312:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323650.760315:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743e200. 02000000:00000001:2.0:1767323650.760317:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323650.760320:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323650.760324:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3b28. 00000100:00000200:2.0:1767323650.760327:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975847040, portal 10 00000100:00000001:2.0:1767323650.760329:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323650.760330:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470911232 : -118678238640384 : ffff941011be4700) 00000100:00000040:2.0:1767323650.760338:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000800:00000200:1.0:1767323650.760341:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c800 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323650.760345:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323650.760349:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 13035 usecs (14 jiffies) 00000100:00000001:1.0:1767323650.760352:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300867598 00000100:00000001:2.0:1767323650.760354:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:1.0:1767323650.760355:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300868845 00000100:00000040:2.0:1767323650.760357:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000100:00000001:1.0:1767323650.760357:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300867598 00000400:00000010:2.0:1767323650.760360:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3220. 00000100:00000001:1.0:1767323650.760360:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300868845 00000100:00000200:2.0:1767323650.760362:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975847040, offset 0 00000100:00000001:1.0:1767323650.760362:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300867598 00000100:00000001:1.0:1767323650.760364:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300868845 00000400:00000200:2.0:1767323650.760367:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:1.0:1767323650.760367:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300867598 00000100:00000001:1.0:1767323650.760369:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300868845 00000400:00000200:2.0:1767323650.760372:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323650.760375:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000001:1.0:1767323650.760375:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000400:00000200:2.0:1767323650.760378:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000100:00000001:1.0:1767323650.760378:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323650.760380:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:2.0:1767323650.760381:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323650.760416:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323650.760419:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1537:1537:254:4294967295] 192.168.204.130@tcp LPNI seq info [1537:1537:6:4294967295] 00000100:00000001:1.0:1767323650.760426:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323650.760427:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:1.0:1767323650.760430:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000800:00000200:2.0:1767323650.760432:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000100:00000001:1.0:1767323650.760432:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323650.760434:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323650.760435:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000800:00000010:2.0:1767323650.760436:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7500. 00000100:00000001:1.0:1767323650.760437:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323650.760439:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:2.0:1767323650.760440:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323650.760444:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323650.760447:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7500 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323650.760450:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323650.760453:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 13723 usecs (14 jiffies) 00000100:00000001:2.0:1767323650.760455:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300867599 00000100:00000001:2.0:1767323650.760458:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300868845 00000100:00000001:2.0:1767323650.760460:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300867599 00000100:00000001:2.0:1767323650.760462:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300868845 00000100:00000001:2.0:1767323650.760463:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300867599 00000100:00000001:2.0:1767323650.760465:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300868845 00000100:00000001:2.0:1767323650.760467:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300867599 00000100:00000001:2.0:1767323650.760469:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300868845 00000100:00000001:2.0:1767323650.760477:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323650.760479:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.760481:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.760483:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323650.760486:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323650.760487:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323650.760489:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323650.760490:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323650.760492:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.760494:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323650.760782:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323650.760787:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7100. 00000400:00000200:0.0:1767323650.760795:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323650.760801:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323650.760807:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc35d8 00000400:00000010:0.0:1767323650.760809:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc35d8. 00000100:00000001:0.0:1767323650.760815:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323650.760820:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.760829:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323650.760832:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.760839:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323650.760841:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323650.760854:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323650.760856:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c800. 00000400:00000200:0.0:1767323650.760858:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323650.760861:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323650.760864:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a5d8 00000400:00000010:0.0:1767323650.760866:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a5d8. 00000100:00000001:0.0:1767323650.760868:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323650.760877:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.760884:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323650.760887:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.760893:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323650.760894:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323650.760971:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323650.760974:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7500. 00000400:00000200:0.0:1767323650.760977:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323650.760981:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323650.760983:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3220 00000400:00000010:0.0:1767323650.760985:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3220. 00000100:00000001:0.0:1767323650.760988:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323650.760991:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.760998:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323650.761001:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.761008:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323650.761009:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:3.0:1767323650.761683:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323650.761688:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323650.765258:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765285:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323650.765290:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765293:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323650.765321:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323650.765344:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953fc80 00000400:00000200:0.0:1767323650.765353:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3209 [1] + 224 00000800:00000001:0.0:1767323650.765364:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765369:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323650.765373:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323650.765378:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323650.765444:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323650.765457:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323650.765469:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.765482:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323650.765493:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765497:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323650.765499:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765501:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323650.765505:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323650.765512:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953fb80 00000400:00000200:0.0:1767323650.765518:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3201 [1] + 224 00000800:00000001:0.0:1767323650.765522:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765526:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323650.765528:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323650.765531:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323650.765534:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323650.765539:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323650.765548:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.765572:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323650.765577:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765581:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323650.765583:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765585:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323650.765589:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323650.765595:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953fc00 00000400:00000200:0.0:1767323650.765600:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x31f9 [1] + 224 00000800:00000001:0.0:1767323650.765611:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765618:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323650.765620:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323650.765623:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323650.765627:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323650.765632:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323650.765640:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323650.765661:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323650.765666:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323650.765669:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323650.765693:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323650.765699:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323650.765709:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323650.765712:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000100:00000001:3.0:1767323650.765717:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000010:1.0:1767323650.765717:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35d10. 00000100:00000001:3.0:1767323650.765722:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000200:1.0:1767323650.765725:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3330 00000400:00000010:1.0:1767323650.765730:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3330. 00000100:00000001:2.0:1767323650.765733:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323650.765733:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000400:00000001:3.0:1767323650.765735:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000100:00000001:2.0:1767323650.765737:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000200:1.0:1767323650.765739:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323650.765748:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323650.765755:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323650.765757:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323650.765760:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323650.765764:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323650.765767:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323650.765769:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323650.765773:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323650.765782:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=103 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323650.765788:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=103 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323650.765791:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323650.765792:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323650.765796:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323650.765798:0:111003:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323650.765802:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:3.0:1767323650.765808:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323650.765812:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410181563c8. 00000100:00000040:1.0:1767323650.765817:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323650.765825:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323650.765829:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323650.765831:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323650.765836:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323650.765844:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975846784:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323650.765849:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323650.765852:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323650.765856:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4000 x1853171975846784/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323650.765863:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323650.765865:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323650.765881:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fa00. 02000000:00000001:1.0:1767323650.765887:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323650.765889:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323650.765892:0:111003:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:1.0:1767323650.765894:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323650.765897:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abc00. 02000000:00000001:1.0:1767323650.765902:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323650.765904:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323650.765907:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4000. 00000100:00000001:1.0:1767323650.765911:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323650.765912:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323650.765914:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323650.765923:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323650.765926:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323650.765928:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323650.765930:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323650.766060:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890a908 00000400:00000010:3.0:1767323650.766064:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890a908. 00000100:00000001:3.0:1767323650.766068:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323650.766074:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323650.766085:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323650.766093:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323650.766095:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323650.766097:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323650.766099:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323650.766100:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323650.766102:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323650.766105:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323650.766111:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=102 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323650.766115:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=102 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323650.766118:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323650.766119:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323650.766121:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323650.766125:0:111001:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323650.766129:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323650.766131:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323650.766142:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323650.766144:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323650.766149:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323650.766156:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323650.766159:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323650.766161:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323650.766164:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323650.766173:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975846912:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323650.766178:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323650.766180:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323650.766183:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4380 x1853171975846912/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323650.766190:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323650.766192:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323650.766194:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010711000. 02000000:00000001:3.0:1767323650.766197:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323650.766199:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323650.766200:0:111001:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323650.766202:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323650.766204:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abb00. 02000000:00000001:3.0:1767323650.766207:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323650.766208:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323650.766209:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4380. 00000100:00000001:3.0:1767323650.766213:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323650.766214:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323650.766216:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323650.766221:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323650.766222:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323650.766224:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323650.766226:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:2.0:1767323650.771141:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323650.771148:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323650.771154:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323650.771173:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3b28 00000400:00000010:2.0:1767323650.771176:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3b28. 00000100:00000001:2.0:1767323650.771182:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323650.771194:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323650.771210:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323650.771218:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323650.771221:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323650.771225:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323650.771228:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323650.771231:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323650.771234:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323650.771237:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323650.771247:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=102 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323650.771250:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=102 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323650.771253:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323650.771254:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323650.771257:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323650.771261:0:111002:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323650.771291:0:111002:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.771295:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323650.771297:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323650.771305:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323650.771306:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323650.771309:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323650.771315:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323650.771317:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323650.771319:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323650.771323:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323650.771328:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975847040:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323650.771331:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323650.771335:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323650.771337:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be4700 x1853171975847040/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323666 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323650.771342:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323650.771344:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323650.771348:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743e200. 02000000:00000001:2.0:1767323650.771351:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323650.771353:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323650.771355:0:111002:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323650.771357:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323650.771360:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab700. 02000000:00000001:2.0:1767323650.771364:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323650.771366:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323650.771368:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be4700. 00000100:00000001:2.0:1767323650.771371:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323650.771372:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323650.771378:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323650.771398:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323650.771400:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323650.771403:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323650.771405:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323651.335517:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323651.335525:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323651.335531:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323651.335532:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323651.335664:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323651.335683:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323651.335686:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323652.039529:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300868845, at 4300868864 00000100:00000010:1.0:1767323652.039548:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49300. 00000100:00000040:3.0:1767323652.039723:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300868845, at 4300868864 00000100:00000010:3.0:1767323652.039729:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49900. 00000100:00000040:0.0:1767323652.039854:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300868845, at 4300868864 00000100:00000010:0.0:1767323652.039860:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a494e0. 00000100:00000040:2.0:1767323652.043726:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300868845, at 4300868868 00000100:00000010:2.0:1767323652.043742:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49660. 00010000:00000001:0.0:1767323652.359627:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323652.359633:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323652.359640:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323652.359641:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323652.359938:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323652.359941:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323652.359943:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323653.383544:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323653.383553:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323653.383559:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323653.383560:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323653.383802:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323653.383805:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323653.383808:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323654.410272:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323654.410283:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323654.410290:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323654.410292:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323654.410494:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323654.410515:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323654.410519:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323655.431732:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323655.431744:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323655.431752:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323655.431753:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323655.432032:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323655.432036:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323655.432040:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323655.879571:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323655.879586:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323655.879601:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6a00. 00000020:00000040:0.0:1767323655.879610:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323655.879616:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323655.879619:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323655.879626:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323655.879638:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab700. 00000100:00000001:0.0:1767323655.879647:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879660:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323655.879672:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323655.879678:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879686:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000515a4373] to pc [ptlrpcd_00_02+2] req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.879729:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879732:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323655.879736:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323655.879740:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be7480. 00000020:00000040:0.0:1767323655.879743:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323655.879746:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323655.879747:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323655.879749:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323655.879753:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abb00. 00000100:00000001:0.0:1767323655.879757:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879761:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323655.879778:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323655.879780:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879784:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d622fa64] to pc [ptlrpcd_00_03+3] req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.879820:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879822:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323655.879826:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323655.879830:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5180. 00000020:00000040:0.0:1767323655.879832:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323655.879835:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323655.879836:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323655.879838:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323655.879842:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abc00. 00000100:00000001:0.0:1767323655.879845:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879850:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323655.879857:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323655.879859:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879863:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000501b1cb0] to pc [ptlrpcd_00_00+0] req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.879893:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323655.879896:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323655.879900:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323655.879902:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323655.879905:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323655.879911:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6210) 00000100:00000001:3.0:1767323655.880502:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323655.880510:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323655.880513:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323655.880523:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.880533:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323655.880536:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323655.880541:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323655.880545:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323655.880549:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323655.880553:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975847296:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323655.880558:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323655.880565:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323655.880568:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323655.880571:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323655.880580:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b4c00. 02000000:00000001:3.0:1767323655.880582:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323655.880590:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410013284d0. 00000400:00000010:3.0:1767323655.880613:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec660. 00000100:00000200:3.0:1767323655.880623:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975847296, portal 10 00000100:00000001:3.0:1767323655.880625:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323655.880637:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470922880 : -118678238628736 : ffff941011be7480) 00000100:00000040:3.0:1767323655.880646:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.880656:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323655.880659:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323655.880663:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec000. 00000100:00000200:3.0:1767323655.880667:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975847296, offset 0 00000400:00000200:3.0:1767323655.880674:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323655.880694:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323655.880701:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323655.880707:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323655.880712:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323655.880715:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323655.880719:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1538:1538:256:4294967295] 192.168.204.130@tcp LPNI seq info [1538:1538:8:4294967295] 00000400:00000200:3.0:1767323655.880734:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323655.880741:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323655.880747:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3300. 00000800:00000200:3.0:1767323655.880756:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323655.880766:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323655.880771:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3300 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323655.880799:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323655.880806:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12850 usecs (13 jiffies) 00000100:00000001:3.0:1767323655.880810:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300872718 00000100:00000010:3.0:1767323655.880815:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907ba0. 00000100:00000001:3.0:1767323655.880823:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:3.0:1767323655.880838:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300872718 00000100:00000010:3.0:1767323655.880841:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907a20. 00000100:00000001:3.0:1767323655.880845:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000100:00000001:3.0:1767323655.880852:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300872718 00000100:00000010:3.0:1767323655.880861:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907480. 00000100:00000001:3.0:1767323655.880865:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:3.0:1767323655.880869:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300872718 00000100:00000010:3.0:1767323655.880872:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907f00. 00000100:00000001:3.0:1767323655.880875:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000100:00000001:3.0:1767323655.880879:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323655.880891:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323655.880896:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323655.880898:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.880909:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323655.880911:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323655.880914:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323655.880915:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323655.880917:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323655.880920:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000001:3.0:1767323655.880922:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.880924:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323655.880925:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.880927:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323655.880937:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323655.880938:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323655.880943:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.880951:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323655.880953:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323655.880955:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323655.880957:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323655.880959:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323655.880962:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975847168:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323655.880966:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323655.880969:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323655.880970:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323655.880972:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323655.880976:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b4800. 02000000:00000001:3.0:1767323655.880984:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323655.880989:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323655.880994:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec198. 00000100:00000200:3.0:1767323655.880997:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975847168, portal 25 00000100:00000001:3.0:1767323655.880999:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323655.881001:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470920192 : -118678238631424 : ffff941011be6a00) 00000100:00000040:3.0:1767323655.881006:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.881013:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323655.881015:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323655.881018:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec2a8. 00000100:00000200:3.0:1767323655.881020:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975847168, offset 0 00000400:00000200:3.0:1767323655.881025:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323655.881030:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323655.881033:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323655.881036:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323655.881038:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323655.881041:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323655.881044:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1539:1539:255:4294967295] 192.168.204.130@tcp LPNI seq info [1539:1539:7:4294967295] 00000400:00000200:3.0:1767323655.881052:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323655.881057:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323655.881061:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3700. 00000800:00000200:3.0:1767323655.881065:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323655.881070:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323655.881073:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323655.881076:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323655.881078:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300873966 00000100:00000001:3.0:1767323655.881085:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300872718 00000100:00000001:3.0:1767323655.881089:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300873966 00000100:00000001:3.0:1767323655.881092:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300872718 00000100:00000001:3.0:1767323655.881101:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300873966 00000100:00000001:3.0:1767323655.881105:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300872718 00000100:00000001:3.0:1767323655.881107:0:111004:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300873966 00000100:00000001:3.0:1767323655.881110:0:111004:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300872718 00000100:00000001:3.0:1767323655.881113:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323655.881115:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323655.881118:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323655.881120:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323655.881832:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323655.881839:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3300. 00000400:00000200:0.0:1767323655.881850:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323655.881859:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323655.881865:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec000 00000400:00000010:0.0:1767323655.881877:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec000. 00000100:00000001:0.0:1767323655.881895:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323655.881903:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.881914:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323655.881917:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.881925:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323655.881927:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323655.882025:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323655.882028:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3700. 00000400:00000200:0.0:1767323655.882032:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323655.882035:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323655.882038:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec2a8 00000400:00000010:0.0:1767323655.882040:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec2a8. 00000100:00000001:0.0:1767323655.882043:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323655.882047:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.882054:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323655.882056:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.882062:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323655.882064:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:1.0:1767323655.883829:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323655.883839:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323655.884722:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323655.884730:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323655.884734:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323655.884751:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323655.884764:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323655.884776:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323655.884781:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323655.884786:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323655.884789:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323655.884792:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975847424:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323655.884797:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323655.884804:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323655.884807:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323655.884809:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323655.884822:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fa00. 02000000:00000001:2.0:1767323655.884824:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323655.884833:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323655.884842:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3b28. 00000100:00000200:2.0:1767323655.884851:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975847424, portal 10 00000100:00000001:2.0:1767323655.884853:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323655.884855:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470913920 : -118678238637696 : ffff941011be5180) 00000100:00000040:2.0:1767323655.884863:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323655.884870:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323655.884873:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323655.884893:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc34c8. 00000100:00000200:2.0:1767323655.884896:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975847424, offset 0 00000400:00000200:2.0:1767323655.884904:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323655.884921:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323655.884927:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323655.884942:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323655.884946:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323655.884950:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323655.884954:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1540:1540:256:4294967295] 192.168.204.130@tcp LPNI seq info [1540:1540:8:4294967295] 00000400:00000200:2.0:1767323655.884967:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323655.884973:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323655.884979:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7600. 00000800:00000200:2.0:1767323655.884986:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323655.884994:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323655.884999:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323655.885011:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323655.885016:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 13742 usecs (14 jiffies) 00000100:00000001:2.0:1767323655.885020:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300872723 00000100:00000001:2.0:1767323655.885023:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300873966 00000100:00000001:2.0:1767323655.885025:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300872723 00000100:00000001:2.0:1767323655.885028:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300873966 00000100:00000001:2.0:1767323655.885030:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300872723 00000100:00000001:2.0:1767323655.885032:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300873966 00000100:00000001:2.0:1767323655.885034:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300872723 00000100:00000001:2.0:1767323655.885037:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300873966 00000100:00000001:2.0:1767323655.885039:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323655.885042:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323655.885045:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323655.885054:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323655.885063:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323655.885065:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323655.885068:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323655.885070:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323655.885071:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323655.885074:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323655.885094:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323655.885097:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323655.886208:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323655.886217:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7600. 00000400:00000200:0.0:1767323655.886225:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323655.886234:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323655.886242:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc34c8 00000400:00000010:0.0:1767323655.886245:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc34c8. 00000100:00000001:0.0:1767323655.886251:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323655.886259:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.886282:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323655.886300:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.886307:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323655.886309:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:0.0:1767323655.887768:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.887856:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323655.887860:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.887863:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323655.887877:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323655.887899:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953fd80 00000400:00000200:0.0:1767323655.887910:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3211 [1] + 224 00000800:00000001:0.0:1767323655.887920:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.887927:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323655.887939:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323655.887944:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323655.887951:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323655.887962:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323655.887973:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.887996:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323655.888006:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.888010:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323655.888012:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.888014:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323655.888018:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323655.888024:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953fd00 00000400:00000200:0.0:1767323655.888031:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3219 [1] + 224 00000800:00000001:0.0:1767323655.888035:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.888040:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323655.888043:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323655.888063:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323655.888067:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323655.888072:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323655.888080:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.888087:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323655.888091:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.888094:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.888156:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323655.888161:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323655.888170:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323655.888172:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323655.888177:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:3.0:1767323655.888182:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec198 00000400:00000010:3.0:1767323655.888185:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec198. 00000100:00000001:3.0:1767323655.888189:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323655.888194:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323655.888203:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.888209:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323655.888211:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.888214:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323655.888217:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323655.888221:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323655.888223:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323655.888228:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323655.888236:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=108 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323655.888242:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=108 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323655.888245:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323655.888247:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323655.888250:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323655.888253:0:111004:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323655.888257:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323655.888330:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.888338:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323655.888342:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323655.888345:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323655.888350:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323655.888358:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a00b263e-ee70-4193-8137-db92c096fca5:111004:1853171975847168:192.168.204.130@tcp:400:kworker.0 00000400:00000001:3.0:1767323655.888365:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323655.888366:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323655.888368:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410013284d0. 00000400:00000200:3.0:1767323655.888371:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec660 00000400:00000010:3.0:1767323655.888373:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec660. 00000100:00000001:3.0:1767323655.888375:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323655.888379:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323655.888964:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.888972:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323655.888975:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.888977:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323655.888979:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323655.888981:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323655.888983:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323655.888986:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323655.888994:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=107 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323655.888997:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=107 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323655.888999:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323655.889001:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323655.889003:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323655.889007:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323655.889011:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323655.889024:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323655.889026:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323655.889028:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323655.889033:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.889040:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323655.889043:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323655.889044:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323655.889048:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323655.889055:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975847296:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323655.889060:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.889063:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323655.889067:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be6a00 x1853171975847168/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.889074:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323655.889077:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323655.889081:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b4800. 02000000:00000001:3.0:1767323655.889086:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323655.889089:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323655.889091:0:111004:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:3.0:1767323655.889094:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323655.889097:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab700. 02000000:00000001:3.0:1767323655.889103:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323655.889105:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323655.889107:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6a00. 00000100:00000001:3.0:1767323655.889112:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323655.889113:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.889114:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323655.889117:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be7480 x1853171975847296/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323655.889123:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323655.889130:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323655.889132:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b4c00. 02000000:00000001:3.0:1767323655.889135:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323655.889136:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323655.889137:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323655.889139:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323655.889141:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abb00. 02000000:00000001:3.0:1767323655.889143:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323655.889145:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323655.889146:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be7480. 00000100:00000001:3.0:1767323655.889148:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323655.889150:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.889152:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323655.889161:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323655.889164:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323655.889166:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323655.889169:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323655.891326:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.891355:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323655.891360:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.891364:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323655.891377:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323655.891597:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953fe00 00000400:00000200:0.0:1767323655.891866:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3221 [1] + 224 00000800:00000001:0.0:1767323655.891879:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.891893:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323655.891897:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323655.891902:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323655.891912:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323655.891924:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323655.891947:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323655.891963:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323655.891975:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323655.891979:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323655.893330:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323655.893340:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323655.893355:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323655.893358:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323655.893363:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323655.893374:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3b28 00000400:00000010:2.0:1767323655.893377:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3b28. 00000100:00000001:2.0:1767323655.893406:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323655.893418:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323655.893431:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323655.893439:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323655.893441:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323655.893444:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323655.893448:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323655.893450:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323655.893453:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323655.893457:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323655.893468:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=107 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323655.893473:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=107 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323655.893476:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323655.893478:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323655.893482:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323655.893487:0:111001:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323655.893494:0:111001:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323655.893519:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323655.893522:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323655.893524:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323655.893526:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323655.893532:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323655.893539:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323655.893543:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323655.893546:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323655.893550:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323655.893558:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975847424:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323655.893564:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323655.893566:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323655.893570:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5180 x1853171975847424/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323671 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323655.893578:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323655.893581:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323655.893586:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fa00. 02000000:00000001:2.0:1767323655.893591:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323655.893594:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323655.893596:0:111001:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323655.893599:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323655.893602:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abc00. 02000000:00000001:2.0:1767323655.893608:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323655.893610:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323655.893612:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5180. 00000100:00000001:2.0:1767323655.893617:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323655.893618:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323655.893621:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323655.893631:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323655.893634:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323655.893643:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323655.893646:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323656.456005:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323656.456014:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323656.456022:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323656.456048:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323656.458453:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323656.458461:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323656.458466:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323657.159543:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300873966, at 4300873984 00000100:00000010:3.0:1767323657.159565:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907f00. 00000100:00000040:2.0:1767323657.159671:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300873966, at 4300873984 00000100:00000010:2.0:1767323657.159677:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907480. 00000100:00000040:0.0:1767323657.159766:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300873966, at 4300873984 00000100:00000010:0.0:1767323657.159774:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907ba0. 00000100:00000040:1.0:1767323657.159856:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300873966, at 4300873984 00000100:00000010:1.0:1767323657.159863:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907a20. 00010000:00000001:0.0:1767323657.479564:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323657.479576:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323657.479578:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323657.479581:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323657.479588:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323657.479590:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323657.479593:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323657.479595:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323657.479600:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323657.479601:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323657.479803:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323657.479808:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323657.479811:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323658.503523:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323658.503538:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323658.503544:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323658.503545:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323658.503765:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323658.503769:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323658.503777:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323659.527494:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323659.527502:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323659.527508:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323659.527512:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323659.527514:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323659.527519:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323659.527521:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323659.527523:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323659.527526:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323659.527529:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323659.527531:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323659.527533:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323659.527617:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323659.527620:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323659.527623:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323660.551578:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323660.551587:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323660.551594:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323660.551595:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323660.551820:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323660.551824:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323660.551827:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323660.999826:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323660.999867:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323660.999880:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118eb800. 00000020:00000040:3.0:1767323660.999887:0:96413:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:3.0:1767323660.999892:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323660.999895:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323660.999901:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323660.999911:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3500. 00000100:00000001:3.0:1767323660.999919:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323660.999930:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323660.999940:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323660.999944:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323660.999967:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000060c9b3ce] to pc [ptlrpcd_00_01+1] req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.000003:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.000006:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323661.000010:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323661.000013:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118e8380. 00000020:00000040:3.0:1767323661.000016:0:96413:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:3.0:1767323661.000029:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323661.000031:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323661.000032:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323661.000036:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3d00. 00000100:00000001:3.0:1767323661.000039:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.000043:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323661.000050:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323661.000052:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.000055:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002c21201d] to pc [ptlrpcd_00_02+2] req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.000081:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.000083:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323661.000086:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323661.000089:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118eaa00. 00000020:00000040:3.0:1767323661.000099:0:96413:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:3.0:1767323661.000101:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323661.000102:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323661.000104:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323661.000108:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3b00. 00000100:00000001:3.0:1767323661.000110:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.000114:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323661.000131:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323661.000133:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.000136:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000db9a28af] to pc [ptlrpcd_00_03+3] req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.000144:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.000146:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:3.0:1767323661.000149:0:96413:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1767323661.000152:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:3.0:1767323661.000155:0:96413:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1767323661.000159:0:96413:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6215) 00000100:00000001:3.0:1767323661.000173:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323661.000177:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323661.000179:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323661.000184:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.000191:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323661.000193:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323661.000197:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323661.000200:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323661.000202:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323661.000206:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975847808:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323661.000210:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323661.000216:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323661.000218:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323661.000220:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323661.000224:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b4000. 02000000:00000001:3.0:1767323661.000226:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323661.000232:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410013284d0. 00000400:00000010:3.0:1767323661.000245:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec660. 00000100:00000200:3.0:1767323661.000252:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975847808, portal 10 00000100:00000001:3.0:1767323661.000255:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323661.000256:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467790848 : -118678241760768 : ffff9410118eaa00) 00000100:00000040:3.0:1767323661.000265:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.000272:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323661.000275:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323661.000278:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec198. 00000100:00000200:3.0:1767323661.000281:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975847808, offset 0 00000400:00000200:3.0:1767323661.000287:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323661.000300:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323661.000306:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000001:2.0:1767323661.000307:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323661.000310:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000200:3.0:1767323661.000311:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000100:00000001:2.0:1767323661.000312:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000400:00000200:3.0:1767323661.000314:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323661.000317:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000040:2.0:1767323661.000317:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1767323661.000322:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1541:1541:256:4294967295] 192.168.204.130@tcp LPNI seq info [1541:1541:8:4294967295] 00000100:00000001:2.0:1767323661.000325:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323661.000326:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323661.000328:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323661.000330:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323661.000332:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1767323661.000333:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00100000:2.0:1767323661.000334:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975847552:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323661.000337:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000800:00000200:3.0:1767323661.000339:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 02000000:00000001:2.0:1767323661.000340:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323661.000341:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323661.000343:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000800:00000010:3.0:1767323661.000344:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3100. 02000000:00000010:2.0:1767323661.000346:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fe00. 02000000:00000001:2.0:1767323661.000347:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:3.0:1767323661.000350:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000400:00000010:2.0:1767323661.000351:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323661.000355:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3b28. 00000800:00000200:3.0:1767323661.000358:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000100:00000200:2.0:1767323661.000358:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975847552, portal 25 00000100:00000001:2.0:1767323661.000359:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323661.000361:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467794432 : -118678241757184 : ffff9410118eb800) 00000800:00000200:3.0:1767323661.000362:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3100 type 1, nob 320 niov 1 nkiov 1 00000100:00000040:2.0:1767323661.000365:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.000371:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323661.000371:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323661.000373:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000100:00000040:3.0:1767323661.000375:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 13877 usecs (14 jiffies) 00000400:00000010:2.0:1767323661.000375:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3ee0. 00000100:00000200:2.0:1767323661.000377:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975847552, offset 0 00000100:00000001:3.0:1767323661.000379:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300877838 00000100:00000010:3.0:1767323661.000398:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907e40. 00000100:00000001:3.0:1767323661.000406:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 0 00000100:00000001:3.0:1767323661.000415:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300877839 00000100:00000010:3.0:1767323661.000419:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907f60. 00000400:00000200:2.0:1767323661.000419:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000001:3.0:1767323661.000428:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 1 00000400:00000200:2.0:1767323661.000429:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323661.000432:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000100:00000001:3.0:1767323661.000433:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300877839 00000400:00000200:2.0:1767323661.000435:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000100:00000010:3.0:1767323661.000437:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907900. 00000400:00000200:2.0:1767323661.000437:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323661.000439:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000001:3.0:1767323661.000440:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 2 00000100:00000001:3.0:1767323661.000442:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300877839 00000400:00000200:2.0:1767323661.000442:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1542:1542:255:4294967295] 192.168.204.130@tcp LPNI seq info [1542:1542:7:4294967295] 00000100:00000010:3.0:1767323661.000445:0:111004:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907f00. 00000100:00000001:3.0:1767323661.000448:0:111004:0:(niobuf.c:677:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request now active for cpu 3 00000400:00000200:2.0:1767323661.000450:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:3.0:1767323661.000451:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000800:00000200:2.0:1767323661.000454:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000100:00000001:3.0:1767323661.000455:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.000458:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000800:00000010:2.0:1767323661.000458:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7e00. 00000100:00000001:3.0:1767323661.000461:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000800:00000200:2.0:1767323661.000462:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323661.000466:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323661.000469:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7e00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323661.000470:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323661.000472:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=10 : 10 : a) 00000100:00000001:2.0:1767323661.000472:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.000474:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323661.000474:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300879086 00000100:00000001:3.0:1767323661.000475:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323661.000477:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323661.000479:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000001:2.0:1767323661.000479:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4300877838 00000100:00000001:3.0:1767323661.000481:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323661.000482:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300879086 00000100:00000001:3.0:1767323661.000483:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323661.000484:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4300877839 00000100:00000001:3.0:1767323661.000485:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323661.000486:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323661.000487:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300879086 00000100:00000001:3.0:1767323661.000488:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323661.000489:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000001:2.0:1767323661.000489:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4300877839 00000100:00000001:2.0:1767323661.000492:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300879086 00000100:00000001:2.0:1767323661.000494:0:111002:0:(niobuf.c:684:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4300877839 00000100:00000001:2.0:1767323661.000496:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323661.000498:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323661.000500:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323661.000502:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323661.000504:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323661.000505:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323661.000506:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=10 : 10 : a) 00000100:00000001:2.0:1767323661.000508:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323661.000509:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323661.000511:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323661.000511:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.000513:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323661.000515:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:2.0:1767323661.000516:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323661.000517:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323661.000518:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323661.000521:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975847680:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323661.000524:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323661.000526:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323661.000532:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323661.000533:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323661.000536:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5000. 02000000:00000001:3.0:1767323661.000537:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323661.000540:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323661.000544:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec2a8. 00000100:00000200:3.0:1767323661.000546:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975847680, portal 10 00000100:00000001:3.0:1767323661.000548:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323661.000549:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467780992 : -118678241770624 : ffff9410118e8380) 00000100:00000040:3.0:1767323661.000554:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.000560:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323661.000562:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323661.000564:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec000. 00000100:00000200:3.0:1767323661.000566:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975847680, offset 0 00000400:00000200:3.0:1767323661.000569:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323661.000574:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323661.000576:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323661.000578:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323661.000580:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323661.000582:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323661.000585:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1543:1543:254:4294967295] 192.168.204.130@tcp LPNI seq info [1543:1543:6:4294967295] 00000400:00000200:3.0:1767323661.000592:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323661.000596:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323661.000599:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3700. 00000800:00000200:3.0:1767323661.000602:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323661.000606:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323661.000609:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323661.000612:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.000614:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 12801 usecs (13 jiffies) 00000100:00000001:3.0:1767323661.000617:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300877838 00000100:00000001:3.0:1767323661.000624:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300879086 00000100:00000001:3.0:1767323661.000626:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300877838 00000100:00000001:3.0:1767323661.000628:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300879086 00000100:00000001:3.0:1767323661.000630:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300877838 00000100:00000001:3.0:1767323661.000632:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300879086 00000100:00000001:3.0:1767323661.000634:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300877838 00000100:00000001:3.0:1767323661.000635:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300879086 00000100:00000001:3.0:1767323661.000637:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323661.000640:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.000642:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.000644:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323661.000918:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323661.000924:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323661.000969:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323661.000973:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3100. 00000400:00000200:0.0:1767323661.000980:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323661.000992:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323661.000997:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec198 00000400:00000010:0.0:1767323661.001000:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec198. 00000100:00000001:0.0:1767323661.001003:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323661.001008:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323661.001016:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323661.001029:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323661.001036:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323661.001037:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323661.001051:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323661.001053:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7e00. 00000400:00000200:0.0:1767323661.001056:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323661.001059:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323661.001062:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3ee0 00000400:00000010:0.0:1767323661.001063:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3ee0. 00000100:00000001:0.0:1767323661.001066:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323661.001069:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323661.001076:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323661.001079:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323661.001084:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323661.001086:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:0.0:1767323661.001165:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323661.001168:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3700. 00000400:00000200:0.0:1767323661.001171:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323661.001175:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323661.001177:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec000 00000400:00000010:0.0:1767323661.001179:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec000. 00000100:00000001:0.0:1767323661.001182:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323661.001185:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323661.001198:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323661.001200:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323661.001206:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323661.001207:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:1.0:1767323661.001330:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323661.001333:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323661.007532:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.007548:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323661.007552:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.007555:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323661.007567:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323661.007583:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x695733953fe80 00000400:00000200:0.0:1767323661.007591:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3231 [1] + 224 00000800:00000001:0.0:1767323661.007599:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.007605:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323661.007608:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323661.007612:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323661.007619:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323661.007628:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323661.007639:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323661.007663:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323661.007671:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.007674:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323661.007736:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323661.007740:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323661.007746:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323661.007748:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323661.007752:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323661.007756:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3b28 00000400:00000010:2.0:1767323661.007759:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3b28. 00000100:00000001:2.0:1767323661.007762:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323661.007767:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323661.007776:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323661.007783:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323661.007784:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323661.007787:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323661.007790:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323661.007792:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323661.007794:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323661.007797:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323661.007803:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=114 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323661.007807:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=114 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323661.007810:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323661.007812:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323661.007814:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323661.007816:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323661.007820:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323661.007824:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323661.007831:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323661.007842:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323661.007845:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323661.007849:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323661.007878:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975847552:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323661.007882:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323661.007885:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323661.007889:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118eb800 x1853171975847552/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323661.007897:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323661.007899:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323661.007903:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fe00. 02000000:00000001:2.0:1767323661.007906:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323661.007909:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323661.007911:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:2.0:1767323661.007913:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323661.007916:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3500. 02000000:00000001:2.0:1767323661.007921:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323661.007922:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323661.007924:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118eb800. 00000100:00000001:2.0:1767323661.007930:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323661.007931:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323661.007934:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323661.007942:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323661.007944:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323661.007946:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323661.007948:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323661.015217:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.015238:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323661.015244:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.015246:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323661.015258:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323661.015276:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ff80 00000400:00000200:0.0:1767323661.015285:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3229 [1] + 224 00000800:00000001:0.0:1767323661.015308:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.015316:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323661.015319:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323661.015325:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323661.015332:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323661.015340:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323661.015351:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.017405:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323661.017409:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323661.017535:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323661.017554:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.017567:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323661.017569:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.017571:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323661.017579:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323661.017592:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x695733953ff00 00000400:00000200:0.0:1767323661.017600:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3239 [1] + 224 00000800:00000001:0.0:1767323661.017606:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.017615:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323661.017617:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323661.017627:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323661.017633:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323661.017639:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323661.017649:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323661.017657:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323661.017661:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323661.017664:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000001:3.0:1767323661.021866:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323661.021873:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323661.021878:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410013284d0. 00000400:00000200:3.0:1767323661.021888:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec660 00000400:00000010:3.0:1767323661.021891:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec660. 00000100:00000001:3.0:1767323661.021896:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323661.021909:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323661.021921:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.021929:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323661.021932:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323661.021934:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323661.021938:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323661.021940:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323661.021943:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323661.021945:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323661.021956:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=113 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323661.021979:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=113 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323661.021982:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323661.021984:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323661.021987:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1767323661.021993:0:111004:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1767323661.021999:0:111004:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.022003:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323661.022005:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323661.022007:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323661.022009:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.022013:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.022019:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323661.022022:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323661.022024:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323661.022027:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323661.022034:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975847808:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323661.022040:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.022043:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323661.022046:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118eaa00 x1853171975847808/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323676 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.022053:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323661.022056:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323661.022061:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b4000. 02000000:00000001:3.0:1767323661.022064:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323661.022068:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323661.022070:0:111004:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323661.022072:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323661.022076:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3b00. 02000000:00000001:3.0:1767323661.022087:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323661.022090:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323661.022092:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118eaa00. 00000100:00000001:3.0:1767323661.022098:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323661.022099:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323661.022103:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.022105:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323661.022108:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323661.022112:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323661.022114:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323661.022116:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:3.0:1767323661.022118:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec2a8 00000400:00000010:3.0:1767323661.022120:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec2a8. 00000100:00000001:3.0:1767323661.022122:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323661.022127:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323661.022135:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.027467:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323661.027472:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323661.027474:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323661.027477:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323661.027479:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323661.027481:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323661.027483:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323661.027493:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=113 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323661.027497:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=113 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323661.027499:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323661.027500:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323661.027503:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323661.027506:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.027510:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1767323661.027512:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:3.0:1767323661.027513:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1767323661.027515:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323661.027523:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.027551:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323661.027554:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323661.027556:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323661.027559:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323661.027564:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975847680:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323661.027569:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323661.027572:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323661.027574:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118e8380 x1853171975847680/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323677 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323661.027578:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323661.027580:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323661.027583:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5000. 02000000:00000001:3.0:1767323661.027587:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323661.027589:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323661.027590:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:3.0:1767323661.027592:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323661.027593:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3d00. 02000000:00000001:3.0:1767323661.027597:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323661.027598:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323661.027599:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118e8380. 00000100:00000001:3.0:1767323661.027602:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323661.027603:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323661.027605:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323661.027611:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323661.027612:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323661.027614:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323661.027616:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323661.576517:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323661.576550:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323661.576557:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323661.576559:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323661.576789:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323661.576794:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323661.576798:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323662.280414:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300879086, at 4300879105 00000100:00000010:1.0:1767323662.280444:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907f60. 00000100:00000040:0.0:1767323662.280760:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300879086, at 4300879105 00000100:00000010:0.0:1767323662.280769:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907e40. 00000100:00000040:3.0:1767323662.281820:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300879086, at 4300879106 00000100:00000010:3.0:1767323662.281833:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907f00. 00000100:00000040:2.0:1767323662.282276:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300879086, at 4300879106 00000100:00000010:2.0:1767323662.282285:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907900. 00010000:00000001:0.0:1767323662.599879:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323662.599887:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323662.599894:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323662.599895:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323662.603256:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323662.603267:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323662.603274:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323663.623718:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323663.623725:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323663.623730:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323663.623731:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323663.623842:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323663.623846:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323663.623849:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323664.647637:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323664.647645:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323664.647652:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323664.647653:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323664.649480:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323664.649486:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323664.649491:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323665.676723:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323665.676730:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323665.676735:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323665.676736:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323665.677673:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323665.677678:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323665.677682:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323666.119562:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323666.119588:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323666.119596:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118e8380. 00000020:00000040:3.0:1767323666.119602:0:96413:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:3.0:1767323666.119695:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323666.119699:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323666.119705:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323666.119714:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3d00. 00000100:00000001:3.0:1767323666.119720:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.119732:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323666.119752:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323666.119757:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.119763:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002c21201d] to pc [ptlrpcd_00_00+0] req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323666.119826:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323666.119830:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323666.119833:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323666.119839:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323666.119847:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323666.119849:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323666.119853:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323666.119856:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323666.119859:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323666.119862:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975847936:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323666.119867:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323666.119872:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323666.119874:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323666.119882:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323666.119887:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941012de4000. 02000000:00000001:0.0:1767323666.119889:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323666.119894:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716268. 00000400:00000010:0.0:1767323666.119901:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997880. 00000100:00000200:0.0:1767323666.119907:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975847936, portal 25 00000100:00000001:0.0:1767323666.119910:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323666.119912:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467780992 : -118678241770624 : ffff9410118e8380) 00000100:00000040:0.0:1767323666.119917:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323666.119924:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323666.119926:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323666.119929:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997770. 00000100:00000200:0.0:1767323666.119932:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975847936, offset 0 00000400:00000200:0.0:1767323666.119938:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323666.119950:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323666.119957:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323666.119961:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323666.119964:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323666.119967:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323666.119970:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1544:1544:256:4294967295] 192.168.204.130@tcp LPNI seq info [1544:1544:8:4294967295] 00000400:00000200:0.0:1767323666.119981:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323666.119986:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323666.119991:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012abe00. 00000800:00000200:0.0:1767323666.119997:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323666.120005:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323666.120145:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012abe00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323666.120169:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323666.120173:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300884205 00000100:00000010:0.0:1767323666.120177:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2a20. 00000100:00000001:0.0:1767323666.120183:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:0.0:1767323666.120196:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300884205 00000100:00000010:0.0:1767323666.120198:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2b40. 00000100:00000001:0.0:1767323666.120201:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:0.0:1767323666.120204:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300884205 00000100:00000010:0.0:1767323666.120206:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba2900. 00000100:00000001:0.0:1767323666.120209:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:0.0:1767323666.120220:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300884205 00000100:00000010:0.0:1767323666.120223:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007ba22a0. 00000100:00000001:0.0:1767323666.120227:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:0.0:1767323666.120230:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323666.120233:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323666.120236:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323666.120238:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323666.120261:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.120264:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323666.120267:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323666.120271:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118eaa00. 00000020:00000040:3.0:1767323666.120274:0:96413:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:3.0:1767323666.120277:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323666.120278:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323666.120281:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323666.120285:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3b00. 00000100:00000001:2.0:1767323666.120287:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323666.120288:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.120292:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.120296:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323666.120306:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323666.120309:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.120314:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000db9a28af] to pc [ptlrpcd_00_01+1] req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.120355:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.120358:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323666.120359:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323666.120371:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.120379:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323666.120381:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323666.120405:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323666.120407:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323666.120410:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323666.120413:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975848064:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323666.120416:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323666.120419:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323666.120420:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323666.120422:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323666.120426:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743e400. 02000000:00000001:2.0:1767323666.120428:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323666.120431:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323666.120436:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3b28. 00000100:00000200:2.0:1767323666.120439:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975848064, portal 10 00000100:00000001:2.0:1767323666.120441:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323666.120442:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467790848 : -118678241760768 : ffff9410118eaa00) 00000100:00000040:2.0:1767323666.120450:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.120457:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323666.120459:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323666.120461:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3088. 00000100:00000200:2.0:1767323666.120464:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975848064, offset 0 00000400:00000200:2.0:1767323666.120469:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323666.120475:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323666.120478:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323666.120481:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323666.120483:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323666.120486:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323666.120489:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1545:1545:255:4294967295] 192.168.204.130@tcp LPNI seq info [1545:1545:7:4294967295] 00000400:00000200:2.0:1767323666.120502:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323666.120507:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323666.120510:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7400. 00000800:00000200:2.0:1767323666.120514:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323666.120519:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323666.120521:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7400 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323666.120525:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323666.120529:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 13517 usecs (14 jiffies) 00000100:00000001:2.0:1767323666.120531:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300882958 00000100:00000001:2.0:1767323666.120534:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300884205 00000100:00000001:2.0:1767323666.120537:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300882958 00000100:00000001:2.0:1767323666.120539:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300884205 00000100:00000001:2.0:1767323666.120541:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300882958 00000100:00000001:2.0:1767323666.120543:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300884205 00000100:00000001:2.0:1767323666.120545:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300882958 00000100:00000001:2.0:1767323666.120547:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300884205 00000100:00000001:2.0:1767323666.120549:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323666.120551:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.120554:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.120555:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.120564:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323666.120566:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323666.120569:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.120570:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323666.120571:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.120573:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323666.120637:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323666.120642:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012abe00. 00000400:00000200:1.0:1767323666.120653:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323666.120658:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323666.120663:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997770 00000400:00000010:1.0:1767323666.120665:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997770. 00000100:00000001:1.0:1767323666.120669:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323666.120673:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323666.120682:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323666.120685:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323666.120692:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323666.120693:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323666.120765:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323666.120767:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7400. 00000400:00000200:1.0:1767323666.120771:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323666.120775:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323666.120777:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3088 00000400:00000010:1.0:1767323666.120779:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3088. 00000100:00000001:1.0:1767323666.120781:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323666.120784:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323666.120791:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323666.120793:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323666.120799:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323666.120800:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:0.0:1767323666.120949:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323666.120952:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323666.120954:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323666.120956:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323666.120957:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323666.120960:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323666.121033:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.121042:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323666.121046:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323666.121050:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118ea300. 00000020:00000040:3.0:1767323666.121053:0:96413:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:3.0:1767323666.121055:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323666.121057:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323666.121059:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323666.121063:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3300. 00000100:00000001:3.0:1767323666.121067:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.121072:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323666.121080:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323666.121083:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.121087:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3d5046c] to pc [ptlrpcd_00_02+2] req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323666.121112:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323666.121115:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:3.0:1767323666.121118:0:96413:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1767323666.121121:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:3.0:1767323666.121124:0:96413:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1767323666.121129:0:96413:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6220) 00000100:00000001:0.0:1767323666.121183:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323666.121186:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323666.121187:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323666.121190:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.121234:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:2.0:1767323666.121238:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000001:2.0:1767323666.121240:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.121244:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323666.121252:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.121254:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.121255:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323666.121256:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323666.121262:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.121269:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323666.121270:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323666.121272:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323666.121274:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323666.121276:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323666.121279:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975848192:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323666.121283:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323666.121285:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323666.121287:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323666.121289:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323666.121293:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fc00. 02000000:00000001:2.0:1767323666.121295:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323666.121298:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a359f8. 00000400:00000010:2.0:1767323666.121302:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3770. 00000100:00000200:2.0:1767323666.121306:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975848192, portal 10 00000100:00000001:2.0:1767323666.121308:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323666.121309:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467789056 : -118678241762560 : ffff9410118ea300) 00000100:00000040:2.0:1767323666.121315:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.121322:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323666.121324:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323666.121326:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc36e8. 00000100:00000200:2.0:1767323666.121329:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975848192, offset 0 00000400:00000200:2.0:1767323666.121333:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323666.121340:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323666.121344:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323666.121347:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323666.121356:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323666.121358:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323666.121361:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1546:1546:256:4294967295] 192.168.204.130@tcp LPNI seq info [1546:1546:8:4294967295] 00000400:00000200:2.0:1767323666.121369:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323666.121374:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323666.121378:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7a00. 00000800:00000200:2.0:1767323666.121398:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323666.121403:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323666.121406:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7a00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323666.121423:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323666.121426:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 14411 usecs (15 jiffies) 00000100:00000001:2.0:1767323666.121429:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300882961 00000100:00000001:2.0:1767323666.121431:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300884205 00000100:00000001:2.0:1767323666.121433:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300882961 00000100:00000001:2.0:1767323666.121435:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300884205 00000100:00000001:2.0:1767323666.121437:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300882961 00000100:00000001:2.0:1767323666.121438:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300884205 00000100:00000001:2.0:1767323666.121440:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300882961 00000100:00000001:2.0:1767323666.121442:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300884205 00000100:00000001:2.0:1767323666.121444:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323666.121446:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.121448:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.121450:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323666.121500:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323666.121503:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:0.0:1767323666.121565:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:0.0:1767323666.121569:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7a00. 00000400:00000200:0.0:1767323666.121573:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323666.121577:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:0.0:1767323666.121581:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc36e8 00000400:00000010:0.0:1767323666.121582:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc36e8. 00000100:00000001:0.0:1767323666.121585:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:0.0:1767323666.121590:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323666.121598:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323666.121601:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323666.121613:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323666.121615:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:0.0:1767323666.123264:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323666.123279:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323666.123282:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323666.123284:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323666.123294:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323666.123309:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x6957339540000 00000400:00000200:0.0:1767323666.123316:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3241 [1] + 224 00000800:00000001:0.0:1767323666.123322:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323666.123328:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323666.123331:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323666.123334:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323666.123341:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323666.123348:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323666.123358:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323666.123405:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323666.123413:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323666.123417:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.123475:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.123479:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323666.123485:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323666.123487:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323666.123491:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716268. 00000400:00000200:2.0:1767323666.123495:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997880 00000400:00000010:2.0:1767323666.123508:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997880. 00000100:00000001:2.0:1767323666.123511:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323666.123516:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323666.123524:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.123530:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323666.123532:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.123534:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323666.123537:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323666.123539:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323666.123541:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323666.123543:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323666.123549:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=119 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323666.123553:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=119 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323666.123555:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323666.123557:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323666.123559:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323666.123561:0:111001:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.123564:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323666.123568:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.123574:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323666.123576:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323666.123578:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323666.123582:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323666.123588:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975847936:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323666.123593:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.123595:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323666.123598:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118e8380 x1853171975847936/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.123614:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323666.123617:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323666.123620:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941012de4000. 02000000:00000001:2.0:1767323666.123624:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323666.123626:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323666.123628:0:111001:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:2.0:1767323666.123630:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323666.123632:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3d00. 02000000:00000001:2.0:1767323666.123636:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323666.123638:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323666.123639:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118e8380. 00000100:00000001:2.0:1767323666.123643:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323666.123644:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.123646:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.123653:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323666.123654:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.123656:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.123658:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:1.0:1767323666.125264:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323666.125280:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323666.125283:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323666.125285:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323666.125297:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323666.125311:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540080 00000400:00000200:1.0:1767323666.125330:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3249 [1] + 224 00000800:00000001:1.0:1767323666.125336:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323666.125345:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323666.125347:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323666.125351:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323666.125357:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323666.125364:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323666.125374:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323666.125422:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323666.125430:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323666.125433:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.125495:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.125498:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323666.125503:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323666.125505:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323666.125508:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323666.125512:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3b28 00000400:00000010:2.0:1767323666.125514:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3b28. 00000100:00000001:2.0:1767323666.125516:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323666.125520:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323666.125528:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.125532:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323666.125534:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.125536:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323666.125538:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323666.125540:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323666.125548:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323666.125551:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323666.125560:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=118 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323666.125564:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=118 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323666.125566:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323666.125568:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323666.125570:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323666.125574:0:111002:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.125577:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323666.125579:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323666.125581:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323666.125582:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323666.125586:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.125592:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323666.125594:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323666.125596:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323666.125599:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323666.125606:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975848064:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323666.125610:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.125612:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323666.125615:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118eaa00 x1853171975848064/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.125621:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323666.125623:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323666.125626:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743e400. 02000000:00000001:2.0:1767323666.125630:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323666.125632:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323666.125633:0:111002:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323666.125635:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323666.125637:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3b00. 02000000:00000001:2.0:1767323666.125646:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323666.125648:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323666.125650:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118eaa00. 00000100:00000001:2.0:1767323666.125655:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323666.125657:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.125659:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.125666:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323666.125668:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.125670:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.125672:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323666.135693:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323666.135718:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323666.135722:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323666.135725:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323666.135749:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323666.135771:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540100 00000400:00000200:0.0:1767323666.135781:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3251 [1] + 224 00000800:00000001:0.0:1767323666.135789:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323666.135858:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323666.135862:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323666.135882:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323666.135890:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323666.135898:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323666.135909:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323666.135935:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323666.135945:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323666.135949:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.136023:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.136028:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1767323666.136036:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323666.136038:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323666.136043:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a359f8. 00000400:00000200:2.0:1767323666.136047:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3770 00000400:00000010:2.0:1767323666.136050:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3770. 00000100:00000001:2.0:1767323666.136054:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323666.136059:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323666.136070:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.136077:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323666.136079:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.136082:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323666.136085:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323666.136088:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323666.136091:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323666.136096:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323666.136106:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=118 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323666.136111:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=118 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323666.136113:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323666.136116:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323666.136119:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1767323666.136124:0:111004:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1767323666.136156:0:111004:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.136161:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1767323666.136163:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:2.0:1767323666.136165:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1767323666.136167:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323666.136172:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.136180:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323666.136182:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323666.136185:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323666.136189:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323666.136196:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975848192:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323666.136201:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.136204:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323666.136208:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118ea300 x1853171975848192/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323682 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323666.136215:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323666.136217:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323666.136221:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fc00. 02000000:00000001:2.0:1767323666.136225:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323666.136228:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323666.136230:0:111004:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:2.0:1767323666.136233:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323666.136236:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3300. 02000000:00000001:2.0:1767323666.136240:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323666.136243:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323666.136245:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118ea300. 00000100:00000001:2.0:1767323666.136252:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323666.136253:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.136261:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323666.136271:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323666.136273:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323666.136275:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323666.136277:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323666.695801:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323666.695810:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323666.695817:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323666.695818:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323666.695919:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323666.695923:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323666.695926:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323667.399580:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300884205, at 4300884224 00000100:00000010:2.0:1767323667.399600:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2900. 00000100:00000040:3.0:1767323667.399707:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300884205, at 4300884224 00000100:00000010:3.0:1767323667.399713:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba22a0. 00000100:00000040:0.0:1767323667.399911:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300884205, at 4300884224 00000100:00000010:0.0:1767323667.399916:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2a20. 00000100:00000040:1.0:1767323667.406185:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300884205, at 4300884230 00000100:00000010:1.0:1767323667.406202:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007ba2b40. 00010000:00000001:0.0:1767323667.719546:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323667.719555:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323667.719557:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323667.719560:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323667.719565:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323667.719567:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323667.719570:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323667.719572:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323667.719575:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323667.719577:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323667.720576:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323667.720581:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323667.720584:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323668.745078:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323668.745084:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323668.745090:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323668.745091:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323668.746080:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323668.746114:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323668.746119:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323669.767511:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323669.767517:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323669.767521:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323669.767524:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323669.767526:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323669.767529:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323669.767546:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323669.767547:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323669.767550:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323669.767551:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323669.767552:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323669.767554:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323669.767773:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323669.767776:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323669.767777:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323670.791577:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323670.791589:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323670.791596:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323670.791598:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323670.791731:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323670.791736:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323670.791740:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323671.240251:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323671.240267:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323671.240282:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3ce00. 00000020:00000040:1.0:1767323671.240290:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:1.0:1767323671.240296:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323671.240299:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323671.240305:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323671.240318:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c800. 00000100:00000001:1.0:1767323671.240345:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240361:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323671.240374:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323671.240379:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240455:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a6162199] to pc [ptlrpcd_00_03+3] req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.240497:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240501:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323671.240504:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323671.240508:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3c700. 00000020:00000040:1.0:1767323671.240511:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323671.240514:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323671.240515:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323671.240517:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323671.240521:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c600. 00000100:00000001:1.0:1767323671.240524:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240528:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323671.240536:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323671.240538:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240542:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0993e43] to pc [ptlrpcd_00_00+0] req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.240558:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240561:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323671.240564:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323671.240567:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3c380. 00000020:00000040:1.0:1767323671.240569:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323671.240572:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323671.240573:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323671.240580:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323671.240584:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c100. 00000100:00000001:1.0:1767323671.240588:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240592:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323671.240598:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323671.240600:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240603:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000969e9325] to pc [ptlrpcd_00_01+1] req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.240611:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323671.240613:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1767323671.240617:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323671.240620:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1767323671.240624:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323671.240629:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6225) 00000100:00000001:3.0:1767323671.240689:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:3.0:1767323671.240695:0:111003:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:3.0:1767323671.240698:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323671.240707:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323671.240710:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323671.240712:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323671.240722:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323671.240725:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323671.240731:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323671.240739:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323671.240742:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323671.240746:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323671.240749:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323671.240753:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323671.240756:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975848320:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323671.240761:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323671.240767:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323671.240770:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323671.240773:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323671.240779:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5400. 02000000:00000001:3.0:1767323671.240781:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323671.240789:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323671.240798:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec2a8. 00000100:00000200:3.0:1767323671.240807:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975848320, portal 25 00000100:00000001:3.0:1767323671.240809:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323671.240811:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456593408 : -118678252958208 : ffff941010e3ce00) 00000100:00000040:3.0:1767323671.240816:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323671.240824:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323671.240827:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323671.240830:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec660. 00000100:00000200:3.0:1767323671.240833:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975848320, offset 0 00000400:00000200:3.0:1767323671.240841:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323671.240858:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323671.240866:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323671.240871:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323671.240876:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323671.240879:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323671.240890:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1547:1547:256:4294967295] 192.168.204.130@tcp LPNI seq info [1547:1547:8:4294967295] 00000400:00000200:3.0:1767323671.240903:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323671.240911:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323671.240916:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3e00. 00000800:00000200:3.0:1767323671.240925:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323671.240935:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323671.240940:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3e00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323671.240959:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323671.240963:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300889326 00000100:00000010:3.0:1767323671.240968:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907f00. 00000100:00000001:3.0:1767323671.240976:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:3.0:1767323671.240983:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300889326 00000100:00000010:3.0:1767323671.240986:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907600. 00000100:00000001:3.0:1767323671.240989:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:3.0:1767323671.240992:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300889326 00000100:00000010:3.0:1767323671.240995:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9410399074e0. 00000100:00000001:3.0:1767323671.240999:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:3.0:1767323671.241007:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300889326 00000100:00000010:3.0:1767323671.241010:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907540. 00000100:00000001:3.0:1767323671.241013:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:3.0:1767323671.241016:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323671.241019:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323671.241023:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323671.241026:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323671.241269:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323671.241274:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3e00. 00000400:00000200:1.0:1767323671.241282:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323671.241288:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323671.241295:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec660 00000400:00000010:1.0:1767323671.241298:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec660. 00000100:00000001:1.0:1767323671.241303:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323671.241307:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.241318:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323671.241322:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.241330:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323671.241332:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:0.0:1767323671.241412:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323671.241416:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323671.241418:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323671.241424:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.241431:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323671.241433:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323671.241435:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323671.241437:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323671.241439:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323671.241443:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975848448:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323671.241446:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323671.241449:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323671.241451:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323671.241452:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323671.241456:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410097e1e00. 02000000:00000001:0.0:1767323671.241459:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323671.241463:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716cb8. 00000400:00000010:0.0:1767323671.241468:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997cc0. 00000100:00000200:0.0:1767323671.241472:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975848448, portal 10 00000100:00000001:0.0:1767323671.241474:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323671.241475:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456591616 : -118678252960000 : ffff941010e3c700) 00000100:00000040:0.0:1767323671.241483:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.241501:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323671.241504:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323671.241507:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089976e8. 00000100:00000200:0.0:1767323671.241510:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975848448, offset 0 00000400:00000200:0.0:1767323671.241515:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323671.241521:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323671.241524:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323671.241527:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323671.241530:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323671.241532:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323671.241535:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1548:1548:256:4294967295] 192.168.204.130@tcp LPNI seq info [1548:1548:8:4294967295] 00000400:00000200:0.0:1767323671.241543:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323671.241547:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323671.241552:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab300. 00000800:00000200:0.0:1767323671.241556:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323671.241560:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323671.241563:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab300 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323671.241577:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323671.241582:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 13291 usecs (14 jiffies) 00000100:00000001:0.0:1767323671.241585:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300888080 00000100:00000001:0.0:1767323671.241588:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300889326 00000100:00000001:0.0:1767323671.241590:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300888080 00000100:00000001:0.0:1767323671.241591:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300889326 00000100:00000001:0.0:1767323671.241593:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300888080 00000100:00000001:0.0:1767323671.241596:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300889326 00000100:00000001:0.0:1767323671.241598:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300888080 00000100:00000001:0.0:1767323671.241600:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300889326 00000100:00000001:0.0:1767323671.241609:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323671.241611:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323671.241613:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323671.241616:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.241620:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323671.241622:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323671.241624:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323671.241625:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323671.241627:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323671.241629:0:111001:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000001:0.0:1767323671.241631:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.241632:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323671.241634:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.241635:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323671.241637:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323671.241638:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323671.241642:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.241660:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323671.241661:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323671.241663:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323671.241665:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323671.241667:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323671.241670:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975848576:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323671.241673:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323671.241676:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323671.241678:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323671.241679:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323671.241682:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410097e0e00. 02000000:00000001:0.0:1767323671.241684:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323671.241687:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716898. 00000400:00000010:0.0:1767323671.241691:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997330. 00000100:00000200:0.0:1767323671.241693:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975848576, portal 10 00000100:00000001:0.0:1767323671.241696:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323671.241697:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456590720 : -118678252960896 : ffff941010e3c380) 00000100:00000040:0.0:1767323671.241708:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.241714:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323671.241716:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323671.241719:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997e58. 00000100:00000200:0.0:1767323671.241721:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975848576, offset 0 00000400:00000200:0.0:1767323671.241725:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323671.241731:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323671.241733:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323671.241747:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323671.241750:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323671.241752:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323671.241755:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1549:1549:255:4294967295] 192.168.204.130@tcp LPNI seq info [1549:1549:7:4294967295] 00000400:00000200:0.0:1767323671.241762:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323671.241766:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323671.241770:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab900. 00000800:00000200:0.0:1767323671.241773:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323671.241777:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323671.241780:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab900 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323671.241783:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323671.241785:0:111001:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 14577 usecs (15 jiffies) 00000100:00000001:0.0:1767323671.241788:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300888081 00000100:00000001:0.0:1767323671.241790:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300889326 00000100:00000001:0.0:1767323671.241792:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300888081 00000100:00000001:0.0:1767323671.241795:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300889326 00000100:00000001:0.0:1767323671.241797:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300888081 00000100:00000001:0.0:1767323671.241799:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300889326 00000100:00000001:0.0:1767323671.241801:0:111001:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300888081 00000100:00000001:0.0:1767323671.241807:0:111001:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300889326 00000100:00000001:0.0:1767323671.241809:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323671.241811:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323671.241813:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323671.241815:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323671.242298:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323671.242303:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab300. 00000400:00000200:1.0:1767323671.242308:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323671.242314:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323671.242318:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089976e8 00000400:00000010:1.0:1767323671.242321:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089976e8. 00000100:00000001:1.0:1767323671.242325:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323671.242330:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.242339:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323671.242342:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.242349:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323671.242351:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323671.242428:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323671.242430:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab900. 00000400:00000200:1.0:1767323671.242433:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323671.242437:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323671.242439:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997e58 00000400:00000010:1.0:1767323671.242441:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997e58. 00000100:00000001:1.0:1767323671.242443:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323671.242446:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.242453:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323671.242455:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.242461:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323671.242463:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:2.0:1767323671.242527:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323671.242532:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323671.242538:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323671.242541:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:0.0:1767323671.245706:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323671.245732:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:0.0:1767323671.245738:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323671.245742:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323671.245756:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:0.0:1767323671.245778:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x6957339540180 00000400:00000200:0.0:1767323671.245790:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3259 [1] + 224 00000800:00000001:0.0:1767323671.245800:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323671.245810:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:0.0:1767323671.245814:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1767323671.245820:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:0.0:1767323671.245829:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323671.245855:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1767323671.245867:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.245886:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:0.0:1767323671.245896:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:0.0:1767323671.245900:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323671.245957:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323671.245963:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323671.245971:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323671.245974:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323671.245978:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:3.0:1767323671.245984:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec2a8 00000400:00000010:3.0:1767323671.245987:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec2a8. 00000100:00000001:3.0:1767323671.246013:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323671.246017:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323671.246028:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323671.246034:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323671.246036:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323671.246039:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323671.246043:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323671.246046:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323671.246049:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323671.246053:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323671.246061:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=124 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323671.246066:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=124 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323671.246069:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323671.246071:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323671.246074:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323671.246077:0:111003:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323671.246080:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323671.246084:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323671.246092:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323671.246096:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323671.246099:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323671.246104:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323671.246112:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975848320:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323671.246117:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323671.246120:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323671.246123:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3ce00 x1853171975848320/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323671.246130:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323671.246140:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323671.246144:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5400. 02000000:00000001:3.0:1767323671.246148:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323671.246151:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323671.246153:0:111003:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:3.0:1767323671.246155:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323671.246158:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c800. 02000000:00000001:3.0:1767323671.246162:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323671.246165:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323671.246167:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3ce00. 00000100:00000001:3.0:1767323671.246171:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323671.246173:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323671.246175:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323671.246185:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323671.246188:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323671.246190:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323671.246192:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:1.0:1767323671.247045:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323671.247055:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323671.247058:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323671.247060:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323671.247069:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323671.247092:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540200 00000400:00000200:1.0:1767323671.247100:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3261 [1] + 224 00000800:00000001:1.0:1767323671.247106:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323671.247111:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323671.247115:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323671.247118:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323671.247123:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323671.247130:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323671.247140:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.247169:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323671.247177:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323671.247181:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323671.247183:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323671.247185:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323671.247189:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323671.247195:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540280 00000400:00000200:1.0:1767323671.247200:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3269 [1] + 224 00000800:00000001:1.0:1767323671.247203:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323671.247261:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323671.247264:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323671.247268:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323671.247271:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323671.247276:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323671.247284:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323671.247290:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323671.247301:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323671.247305:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.247619:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323671.247624:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1767323671.247630:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323671.247632:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323671.247635:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716898. 00000400:00000200:0.0:1767323671.247640:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997330 00000400:00000010:0.0:1767323671.247643:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997330. 00000100:00000001:0.0:1767323671.247657:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323671.247663:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323671.247678:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.247684:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323671.247687:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.247690:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323671.247692:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323671.247695:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323671.247697:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323671.247699:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323671.247709:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=123 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323671.247712:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=123 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323671.247714:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323671.247716:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323671.247718:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1767323671.247724:0:111001:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1767323671.247730:0:111001:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323671.247745:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323671.247748:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323671.247750:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323671.247752:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323671.247756:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.247763:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323671.247767:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323671.247768:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323671.247771:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323671.247778:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975848576:192.168.204.130@tcp:400:kworker.0 00000400:00000001:0.0:1767323671.247792:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323671.247794:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323671.247795:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716cb8. 00000400:00000200:0.0:1767323671.247798:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997cc0 00000400:00000010:0.0:1767323671.247800:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997cc0. 00000100:00000001:0.0:1767323671.247802:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323671.247806:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323671.247813:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.247819:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323671.247820:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.247822:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323671.247823:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323671.247825:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323671.247826:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323671.247827:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323671.247974:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=123 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323671.247977:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=123 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323671.247980:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323671.247981:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323671.247983:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323671.247985:0:111001:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323671.247988:0:111001:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323671.247990:0:111001:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323671.247991:0:111001:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323671.247993:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323671.247997:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.248003:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323671.248005:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323671.248006:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323671.248009:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323671.248036:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111001:1853171975848448:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323671.248041:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.248044:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323671.248047:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3c380 x1853171975848576/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.248054:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323671.248056:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323671.248060:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410097e0e00. 02000000:00000001:0.0:1767323671.248063:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323671.248066:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323671.248068:0:111001:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323671.248070:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323671.248072:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c100. 02000000:00000001:0.0:1767323671.248076:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323671.248078:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323671.248079:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3c380. 00000100:00000001:0.0:1767323671.248083:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323671.248085:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.248086:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323671.248089:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3c700 x1853171975848448/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323687 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323671.248095:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323671.248097:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323671.248098:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410097e1e00. 02000000:00000001:0.0:1767323671.248100:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323671.248101:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323671.248103:0:111001:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323671.248105:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323671.248106:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c600. 02000000:00000001:0.0:1767323671.248108:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323671.248110:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323671.248111:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3c700. 00000100:00000001:0.0:1767323671.248119:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323671.248120:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.248123:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323671.248132:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323671.248134:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323671.248136:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323671.248139:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323671.815540:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323671.815550:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323671.815556:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323671.815558:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323671.815627:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323671.815631:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323671.815642:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323672.519683:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300889326, at 4300889344 00000100:00000010:0.0:1767323672.519710:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907f00. 00000100:00000040:3.0:1767323672.519917:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300889326, at 4300889344 00000100:00000010:3.0:1767323672.519925:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907540. 00000100:00000040:2.0:1767323672.521088:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300889326, at 4300889345 00000100:00000040:1.0:1767323672.521088:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300889326, at 4300889345 00000100:00000010:2.0:1767323672.521102:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9410399074e0. 00000100:00000010:1.0:1767323672.521155:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907600. 00010000:00000001:0.0:1767323672.839644:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323672.839655:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323672.839663:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323672.839664:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323672.839766:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323672.839771:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323672.839774:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323673.864913:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323673.864923:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323673.864930:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323673.864932:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323673.867439:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323673.867446:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323673.867452:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323674.893748:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323674.893759:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323674.893766:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323674.893768:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323674.893857:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323674.893861:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323674.893865:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323675.911589:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323675.911596:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323675.911601:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323675.911602:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323675.911698:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323675.911701:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323675.911704:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1767323676.360015:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323676.360026:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323676.360038:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3f480. 00000020:00000040:1.0:1767323676.360044:0:120440:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:1.0:1767323676.360049:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323676.360053:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323676.360059:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323676.360067:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cf00. 00000100:00000001:1.0:1767323676.360074:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323676.360085:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323676.360096:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:1.0:1767323676.360100:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323676.360106:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a96c566] to pc [ptlrpcd_00_02+2] req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.360146:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323676.360149:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:1.0:1767323676.360152:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:1.0:1767323676.360155:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3ca80. 00000020:00000040:1.0:1767323676.360157:0:120440:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:1.0:1767323676.360159:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:1.0:1767323676.360161:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:1.0:1767323676.360177:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:1.0:1767323676.360181:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4cb00. 00000100:00000001:1.0:1767323676.360185:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323676.360191:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:1.0:1767323676.360198:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323676.360201:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323676.360202:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360208:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000040:1.0:1767323676.360209:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008e400271] to pc [ptlrpcd_00_03+3] req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323676.360211:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323676.360219:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.360223:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323676.360228:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323676.360231:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323676.360234:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.360234:0:120440:0:(pinger.c:119:ptlrpc_ping()) Process entered 02000000:00000001:3.0:1767323676.360239:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000010:1.0:1767323676.360240:0:120440:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941010e3d500. 02000000:00000001:3.0:1767323676.360242:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000020:00000040:1.0:1767323676.360244:0:120440:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 02000000:00000001:3.0:1767323676.360245:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.360250:0:120440:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 00000100:00100000:3.0:1767323676.360251:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975848704:192.168.204.130@tcp:400:kworker.0 02000000:00000001:1.0:1767323676.360253:0:120440:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 00000100:00000001:3.0:1767323676.360256:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323676.360257:0:120440:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323676.360261:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000010:1.0:1767323676.360262:0:120440:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941005b4c900. 02000000:00000001:3.0:1767323676.360264:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.360267:0:120440:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323676.360268:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000040:1.0:1767323676.360274:0:120440:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 02000000:00000010:3.0:1767323676.360280:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5e00. 00000100:00000001:1.0:1767323676.360282:0:120440:0:(jobid.c:940:lustre_get_jobid()) Process entered 02000000:00000001:3.0:1767323676.360284:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.360286:0:120440:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323676.360290:0:120440:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003460c418] to pc [ptlrpcd_00_00+0] req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000010:3.0:1767323676.360297:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323676.360303:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec2a8. 00000100:00000200:3.0:1767323676.360309:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975848704, portal 25 00000100:00000001:3.0:1767323676.360310:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323676.360312:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456603264 : -118678252948352 : ffff941010e3f480) 00000100:00000040:3.0:1767323676.360317:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.360319:0:120440:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323676.360324:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323676.360327:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323676.360330:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1767323676.360331:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323676.360335:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec7f8. 00000100:00000040:1.0:1767323676.360336:0:120440:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000200:3.0:1767323676.360339:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975848704, offset 0 00000400:00000200:3.0:1767323676.360344:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000100:00000040:1.0:1767323676.360349:0:120440:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:1.0:1767323676.360355:0:120440:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6230) 00000400:00000200:3.0:1767323676.360358:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323676.360363:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323676.360371:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323676.360374:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323676.360376:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323676.360379:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1550:1550:256:4294967295] 192.168.204.130@tcp LPNI seq info [1550:1550:8:4294967295] 00000400:00000200:3.0:1767323676.360413:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323676.360417:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323676.360433:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3200. 00000800:00000200:3.0:1767323676.360442:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323676.360450:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000100:00000001:2.0:1767323676.360454:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000800:00000200:3.0:1767323676.360455:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3200 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323676.360459:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323676.360462:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323676.360469:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323676.360472:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360478:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300894446 00000100:00000001:2.0:1767323676.360481:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000010:3.0:1767323676.360483:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907540. 00000100:00000001:2.0:1767323676.360485:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323676.360489:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000100:00000001:3.0:1767323676.360491:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:3.0:1767323676.360497:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300894446 02000000:00000001:2.0:1767323676.360498:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 00000100:00000010:3.0:1767323676.360501:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907960. 02000000:00000001:2.0:1767323676.360502:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323676.360507:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975848832:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323676.360510:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:2.0:1767323676.360513:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323676.360516:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323676.360518:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360521:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300894446 02000000:00000001:2.0:1767323676.360522:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000010:3.0:1767323676.360527:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941039907600. 02000000:00000010:2.0:1767323676.360527:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743f200. 02000000:00000001:2.0:1767323676.360533:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360534:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:3.0:1767323676.360538:0:111003:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300894446 00000400:00000010:2.0:1767323676.360539:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a359f8. 00000100:00000010:3.0:1767323676.360541:0:111003:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff9410399074e0. 00000100:00000001:3.0:1767323676.360545:0:111003:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:3.0:1767323676.360547:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000400:00000010:2.0:1767323676.360547:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3770. 00000100:00000001:3.0:1767323676.360549:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360561:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000200:2.0:1767323676.360563:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975848832, portal 10 00000100:00000001:3.0:1767323676.360564:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323676.360568:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323676.360570:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456592512 : -118678252959104 : ffff941010e3ca80) 00000100:00000001:3.0:1767323676.360574:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000040:2.0:1767323676.360577:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323676.360578:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323676.360584:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323676.360586:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323676.360590:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323676.360591:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000001:3.0:1767323676.360594:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323676.360595:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323676.360600:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3b28. 00000100:00000200:2.0:1767323676.360603:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975848832, offset 0 00000400:00000200:2.0:1767323676.360608:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323676.360614:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323676.360618:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323676.360620:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000100:00000001:3.0:1767323676.360622:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000200:2.0:1767323676.360623:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000100:00100000:3.0:1767323676.360628:0:111002:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000400:00000200:2.0:1767323676.360628:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000100:00000001:3.0:1767323676.360633:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323676.360634:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1551:1551:255:4294967295] 192.168.204.130@tcp LPNI seq info [1551:1551:7:4294967295] 00000100:00000001:3.0:1767323676.360639:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323676.360643:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323676.360648:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000200:2.0:1767323676.360648:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000100:00000001:3.0:1767323676.360651:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323676.360654:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000800:00000200:2.0:1767323676.360658:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323676.360663:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7700. 00000100:00000040:3.0:1767323676.360664:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323676.360676:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323676.360678:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323676.360680:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 00000800:00000200:2.0:1767323676.360682:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 02000000:00000001:3.0:1767323676.360683:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323676.360685:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323676.360690:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941010e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975848960:192.168.204.130@tcp:400:kworker.0 00000800:00000200:2.0:1767323676.360697:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000100:00000001:3.0:1767323676.360698:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 00000800:00000200:2.0:1767323676.360701:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323676.360705:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323676.360709:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 00000100:00000040:2.0:1767323676.360711:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 13160 usecs (14 jiffies) 02000000:00000001:3.0:1767323676.360713:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323676.360716:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300893199 02000000:00000001:3.0:1767323676.360717:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 00000100:00000001:2.0:1767323676.360720:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300894446 02000000:00000010:3.0:1767323676.360722:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b5000. 00000100:00000001:2.0:1767323676.360723:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300893199 02000000:00000001:3.0:1767323676.360727:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323676.360728:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300894446 00000100:00000001:2.0:1767323676.360732:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300893199 00000400:00000010:3.0:1767323676.360733:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff9410013284d0. 00000100:00000001:2.0:1767323676.360735:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300894446 00000100:00000001:2.0:1767323676.360738:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300893199 00000400:00000010:3.0:1767323676.360740:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecbb0. 00000100:00000001:2.0:1767323676.360741:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300894446 00000100:00000200:3.0:1767323676.360746:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975848960, portal 10 00000100:00000001:2.0:1767323676.360746:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323676.360752:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360753:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323676.360756:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395456595200 : -118678252956416 : ffff941010e3d500) 00000100:00000001:2.0:1767323676.360756:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323676.360760:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323676.360766:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000040:3.0:1767323676.360768:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323676.360768:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323676.360773:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323676.360775:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323676.360777:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323676.360781:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360783:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323676.360788:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323676.360791:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aecaa0. 00000100:00000200:3.0:1767323676.360794:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975848960, offset 0 00000400:00000200:3.0:1767323676.360799:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323676.360805:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323676.360808:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323676.360811:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323676.360813:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323676.360815:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323676.360818:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1552:1552:254:4294967295] 192.168.204.130@tcp LPNI seq info [1552:1552:6:4294967295] 00000400:00000200:3.0:1767323676.360838:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323676.360842:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323676.360846:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3600. 00000800:00000200:3.0:1767323676.360850:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323676.360853:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323676.360856:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3600 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323676.360859:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323676.360862:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 14366 usecs (15 jiffies) 00000100:00000001:3.0:1767323676.360864:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300893200 00000100:00000001:3.0:1767323676.360871:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300894446 00000100:00000001:3.0:1767323676.360874:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300893200 00000100:00000001:3.0:1767323676.360876:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300894446 00000100:00000001:3.0:1767323676.360878:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300893200 00000100:00000001:3.0:1767323676.360880:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300894446 00000100:00000001:3.0:1767323676.360882:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300893200 00000100:00000001:3.0:1767323676.360884:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300894446 00000100:00000001:3.0:1767323676.360886:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323676.360889:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360891:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.360893:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323676.360922:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323676.360926:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323676.361012:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323676.361016:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3200. 00000400:00000200:1.0:1767323676.361025:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323676.361030:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323676.361036:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec7f8 00000400:00000010:1.0:1767323676.361038:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec7f8. 00000100:00000001:1.0:1767323676.361042:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323676.361046:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.361054:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323676.361057:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.361063:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.361065:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323676.361076:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323676.361078:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7700. 00000400:00000200:1.0:1767323676.361080:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323676.361083:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323676.361085:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3b28 00000400:00000010:1.0:1767323676.361087:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3b28. 00000100:00000001:1.0:1767323676.361089:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323676.361092:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.361098:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323676.361100:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.361105:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.361106:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323676.361167:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323676.361176:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3600. 00000400:00000200:1.0:1767323676.361179:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323676.361183:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323676.361185:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecaa0 00000400:00000010:1.0:1767323676.361187:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecaa0. 00000100:00000001:1.0:1767323676.361189:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323676.361192:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.361199:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323676.361201:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.361207:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.361208:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:0.0:1767323676.365369:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.366874:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1767323676.366881:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.366886:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323676.366899:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323676.366920:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x6957339540300 00000400:00000200:2.0:1767323676.366929:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3271 [1] + 224 00000800:00000001:2.0:1767323676.366937:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.366942:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323676.366959:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323676.366964:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:2.0:1767323676.366972:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323676.366981:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323676.366991:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323676.367046:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323676.367051:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323676.367068:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1767323676.367078:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.367082:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1767323676.367084:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.367087:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323676.367091:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323676.367096:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540380 00000400:00000200:2.0:1767323676.367103:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3279 [1] + 224 00000800:00000001:2.0:1767323676.367106:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.367110:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323676.367112:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323676.367116:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:2.0:1767323676.367119:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323676.367124:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323676.367133:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323676.367156:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1767323676.367161:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.367164:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:2.0:1767323676.367166:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.367168:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323676.367172:0:110996:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:2.0:1767323676.367177:0:110996:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540400 00000400:00000200:2.0:1767323676.367188:0:110996:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3281 [1] + 224 00000800:00000001:2.0:1767323676.367192:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.367241:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:2.0:1767323676.367244:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1767323676.367247:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:2.0:1767323676.367251:0:110996:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323676.367255:0:110996:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1767323676.367264:0:110996:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323676.367282:0:110996:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:2.0:1767323676.367287:0:110996:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:2.0:1767323676.367290:0:110996:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323676.367344:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323676.367347:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323676.367353:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323676.367355:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323676.367358:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff9410013284d0. 00000400:00000200:1.0:1767323676.367363:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aecbb0 00000400:00000010:1.0:1767323676.367365:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aecbb0. 00000100:00000001:1.0:1767323676.367368:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323676.367373:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323676.367381:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.367425:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323676.367428:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323676.367430:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323676.367433:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323676.367436:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323676.367438:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323676.367441:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323676.367449:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=128 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323676.367453:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=128 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323676.367462:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323676.367464:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323676.367467:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:1.0:1767323676.367473:0:111002:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1767323676.367480:0:111002:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.367483:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323676.367485:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323676.367487:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323676.367488:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323676.367492:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.367499:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323676.367503:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323676.367504:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323676.367508:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323676.367521:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975848960:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323676.367526:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323676.367529:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323676.367533:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3d500 x1853171975848960/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323676.367539:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323676.367541:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323676.367545:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5000. 02000000:00000001:1.0:1767323676.367549:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323676.367561:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323676.367564:0:111002:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:1.0:1767323676.367566:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323676.367569:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4c900. 02000000:00000001:1.0:1767323676.367572:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323676.367579:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323676.367581:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3d500. 00000100:00000001:1.0:1767323676.367585:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323676.367586:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323676.367588:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323676.367596:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323676.367598:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323676.367600:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323676.367602:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323676.368091:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323676.368094:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1767323676.368099:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323676.368101:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323676.368103:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a359f8. 00000400:00000200:0.0:1767323676.368108:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3770 00000400:00000010:0.0:1767323676.368117:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3770. 00000100:00000001:0.0:1767323676.368121:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323676.368126:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323676.368135:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323676.368141:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323676.368143:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323676.368145:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323676.368147:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323676.368148:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323676.368149:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323676.368151:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323676.368156:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=128 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323676.368159:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=128 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323676.368162:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323676.368163:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323676.368165:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323676.368167:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323676.368170:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323676.368171:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323676.368173:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323676.368174:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323676.368178:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323676.368185:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323676.368187:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323676.368188:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323676.368192:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323676.368198:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975848832:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323676.368202:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323676.368209:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323676.368213:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3ca80 x1853171975848832/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323676.368218:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323676.368220:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323676.368222:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743f200. 02000000:00000001:0.0:1767323676.368225:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323676.368226:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323676.368228:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323676.368230:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323676.368231:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cb00. 02000000:00000001:0.0:1767323676.368233:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323676.368235:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323676.368236:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3ca80. 00000100:00000001:0.0:1767323676.368239:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323676.368240:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323676.368241:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323676.368246:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323676.368248:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323676.368249:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323676.368251:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000400:00000001:3.0:1767323676.368590:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323676.368593:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323676.368595:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:3.0:1767323676.368599:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec2a8 00000400:00000010:3.0:1767323676.368600:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec2a8. 00000100:00000001:3.0:1767323676.368603:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323676.368608:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323676.368617:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323676.368624:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323676.368625:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323676.368627:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323676.368629:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323676.368630:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323676.368631:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323676.368633:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323676.368637:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=129 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323676.368640:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=129 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323676.368648:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323676.368650:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323676.368652:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323676.368653:0:111003:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.368655:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323676.368659:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323676.368666:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323676.368668:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323676.368669:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323676.368673:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323676.368680:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941010e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a00b263e-ee70-4193-8137-db92c096fca5:111003:1853171975848704:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323676.368684:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323676.368686:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323676.368689:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941010e3f480 x1853171975848704/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323692 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323676.368695:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323676.368697:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323676.368699:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b5e00. 02000000:00000001:3.0:1767323676.368702:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323676.368703:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323676.368704:0:111003:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:3.0:1767323676.368706:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323676.368708:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941005b4cf00. 02000000:00000001:3.0:1767323676.368710:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323676.368711:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323676.368713:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941010e3f480. 00000100:00000001:3.0:1767323676.368716:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323676.368717:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323676.368718:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323676.368722:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323676.368724:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323676.368730:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323676.368732:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323676.937487:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323676.937492:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323676.937497:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323676.937499:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323676.937625:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323676.937628:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323676.937631:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1767323677.639582:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300894446, at 4300894464 00000100:00000010:2.0:1767323677.639598:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907600. 00000100:00000040:0.0:1767323677.639696:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300894446, at 4300894464 00000100:00000010:0.0:1767323677.639703:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907540. 00000100:00000040:1.0:1767323677.639772:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300894446, at 4300894464 00000100:00000010:1.0:1767323677.639779:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941039907960. 00000100:00000040:3.0:1767323677.640279:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300894446, at 4300894464 00000100:00000010:3.0:1767323677.640293:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff9410399074e0. 00010000:00000001:0.0:1767323677.960545:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323677.960558:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323677.960561:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323677.960565:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323677.960573:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323677.960576:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323677.960578:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323677.960580:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323677.960584:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323677.960596:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323677.960674:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323677.960678:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323677.960680:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323678.983541:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323678.983551:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323678.983559:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323678.983560:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323678.983662:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323678.983667:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323678.983671:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323680.007560:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323680.007578:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323680.007586:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323680.007591:0:114754:0:(ldlm_request.c:2117:ldlm_cancel_lru()) Process entered 00010000:00000001:0.0:1767323680.007594:0:114754:0:(ldlm_request.c:1927:ldlm_prepare_lru_list()) Process entered 00010000:00000001:0.0:1767323680.007601:0:114754:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1767323680.007604:0:114754:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:0.0:1767323680.007606:0:114754:0:(ldlm_request.c:2085:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323680.007609:0:114754:0:(ldlm_lockd.c:2240:ldlm_bl_to_thread()) Process entered 00010000:00000001:0.0:1767323680.007611:0:114754:0:(ldlm_lockd.c:2243:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323680.007614:0:114754:0:(ldlm_request.c:2127:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323680.007616:0:114754:0:(ldlm_pool.c:497:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323680.007673:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323680.007678:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323680.007681:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323681.032107:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323681.032115:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323681.032122:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323681.032123:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323681.033096:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323681.033101:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323681.033105:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323681.479724:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323681.479736:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323681.479747:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118ea300. 00000020:00000040:3.0:1767323681.479755:0:96413:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:3.0:1767323681.479759:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323681.479762:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323681.479767:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323681.479776:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3f00. 00000100:00000001:3.0:1767323681.479782:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.479795:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323681.479807:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323681.479812:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.479819:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a3d5046c] to pc [ptlrpcd_00_01+1] req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.479858:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.479862:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323681.479866:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323681.479869:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118eaa00. 00000020:00000040:3.0:1767323681.479872:0:96413:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:3.0:1767323681.479874:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323681.479875:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323681.479892:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323681.479896:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3900. 00000100:00000001:3.0:1767323681.479900:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.479905:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323681.479913:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323681.479915:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.479921:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000db9a28af] to pc [ptlrpcd_00_02+2] req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.479945:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.479948:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:3.0:1767323681.479951:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:3.0:1767323681.479954:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff9410118e8380. 00000020:00000040:3.0:1767323681.479957:0:96413:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:3.0:1767323681.479959:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1767323681.479961:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1767323681.479962:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1767323681.479966:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff941006cb3a00. 00000100:00000001:3.0:1767323681.479968:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.479983:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:3.0:1767323681.479992:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1767323681.479994:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.479998:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002c21201d] to pc [ptlrpcd_00_03+3] req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.480006:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.480009:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:3.0:1767323681.480013:0:96413:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1767323681.480015:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:3.0:1767323681.480024:0:96413:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:3.0:1767323681.480029:0:96413:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6236) 00000100:00000001:1.0:1767323681.480187:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323681.480191:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323681.480194:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1767323681.480200:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323681.480207:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1767323681.480209:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323681.480213:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1767323681.480216:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1767323681.480218:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1767323681.480221:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975849088:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323681.480225:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1767323681.480230:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1767323681.480233:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323681.480235:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1767323681.480241:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94101a057e00. 02000000:00000001:1.0:1767323681.480242:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1767323681.480249:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941018156a50. 00000400:00000010:1.0:1767323681.480255:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890acc0. 00000100:00000200:1.0:1767323681.480262:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975849088, portal 25 00000100:00000001:1.0:1767323681.480264:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1767323681.480271:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467789056 : -118678241762560 : ffff9410118ea300) 00000100:00000040:1.0:1767323681.480277:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323681.480283:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1767323681.480286:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:1.0:1767323681.480288:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff94101890af68. 00000100:00000200:1.0:1767323681.480291:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975849088, offset 0 00000400:00000200:1.0:1767323681.480297:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:1.0:1767323681.480309:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:1.0:1767323681.480315:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:1.0:1767323681.480319:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:1.0:1767323681.480324:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:1.0:1767323681.480326:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:1.0:1767323681.480330:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1553:1553:256:4294967295] 192.168.204.130@tcp LPNI seq info [1553:1553:8:4294967295] 00000400:00000200:1.0:1767323681.480341:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:1.0:1767323681.480346:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:1.0:1767323681.480351:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941005b4c900. 00000800:00000200:1.0:1767323681.480357:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:1.0:1767323681.480364:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:1.0:1767323681.480369:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941005b4c900 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:1.0:1767323681.480407:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323681.480412:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300899566 00000100:00000010:1.0:1767323681.480416:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5000. 00000100:00000001:1.0:1767323681.480422:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1767323681.480428:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300899566 00000100:00000010:1.0:1767323681.480431:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5c00. 00000100:00000001:1.0:1767323681.480433:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:1.0:1767323681.480436:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300899566 00000100:00000010:1.0:1767323681.480439:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5660. 00000100:00000001:1.0:1767323681.480442:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1767323681.480451:0:111002:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300899566 00000100:00000010:1.0:1767323681.480454:0:111002:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941010de5ea0. 00000100:00000001:1.0:1767323681.480469:0:111002:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1767323681.480476:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323681.480479:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323681.480483:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323681.480485:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323681.480493:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323681.480495:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:1.0:1767323681.480497:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323681.480498:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1767323681.480499:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323681.480501:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:3.0:1767323681.480825:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323681.480830:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941005b4c900. 00000400:00000200:3.0:1767323681.480835:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323681.480840:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323681.480845:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890af68 00000400:00000010:3.0:1767323681.480847:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890af68. 00000100:00000001:3.0:1767323681.480851:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323681.480855:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.480863:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323681.480867:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.480873:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323681.480874:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:1.0:1767323681.482882:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323681.482900:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323681.482904:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323681.482906:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323681.482918:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323681.482936:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x6957339540480 00000400:00000200:1.0:1767323681.482944:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x3289 [1] + 224 00000800:00000001:1.0:1767323681.482953:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323681.482961:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323681.482964:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323681.482969:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323681.482988:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323681.482997:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323681.483008:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323681.483026:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323681.483034:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323681.483038:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323681.483182:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323681.483186:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1767323681.483192:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1767323681.483194:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1767323681.483197:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941018156a50. 00000400:00000200:3.0:1767323681.483202:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff94101890acc0 00000400:00000010:3.0:1767323681.483204:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff94101890acc0. 00000100:00000001:3.0:1767323681.483207:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323681.483212:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1767323681.483220:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.483226:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:3.0:1767323681.483228:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323681.483230:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:3.0:1767323681.483233:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1767323681.483235:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1767323681.483251:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323681.483254:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1767323681.483261:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=134 v=5 (5 0 0 0) 00000100:00001000:3.0:1767323681.483265:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=134 v=5 (1 0 0 0) 00000100:00000001:3.0:1767323681.483268:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1767323681.483269:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1767323681.483272:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1767323681.483274:0:111002:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323681.483277:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323681.483281:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.483288:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323681.483292:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1767323681.483293:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1767323681.483297:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1767323681.483303:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a00b263e-ee70-4193-8137-db92c096fca5:111002:1853171975849088:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323681.483308:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323681.483310:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323681.483313:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118ea300 x1853171975849088/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.483319:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1767323681.483322:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1767323681.483326:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94101a057e00. 02000000:00000001:3.0:1767323681.483330:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1767323681.483332:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:3.0:1767323681.483334:0:111002:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:3.0:1767323681.483336:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:3.0:1767323681.483339:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3f00. 02000000:00000001:3.0:1767323681.483343:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1767323681.483345:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1767323681.483346:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118ea300. 00000100:00000001:3.0:1767323681.483351:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1767323681.483359:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323681.483361:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323681.483369:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323681.483371:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323681.483373:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323681.483375:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.483698:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323681.483701:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.483706:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323681.483708:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323681.483711:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323681.483719:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.483726:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323681.483728:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323681.483732:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323681.483735:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323681.483738:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323681.483741:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975849344:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323681.483744:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323681.483749:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323681.483758:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323681.483760:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323681.483765:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010c03e00. 02000000:00000001:0.0:1767323681.483766:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323681.483770:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716cb8. 00000400:00000010:0.0:1767323681.483776:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997cc0. 00000100:00000200:0.0:1767323681.483782:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975849344, portal 10 00000100:00000001:0.0:1767323681.483784:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323681.483785:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467780992 : -118678241770624 : ffff9410118e8380) 00000100:00000040:0.0:1767323681.483792:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.483798:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323681.483800:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323681.483802:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997330. 00000100:00000200:0.0:1767323681.483805:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975849344, offset 0 00000400:00000200:0.0:1767323681.483810:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323681.483821:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323681.483826:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323681.483830:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323681.483833:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323681.483846:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323681.483850:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1554:1554:256:4294967295] 192.168.204.130@tcp LPNI seq info [1554:1554:8:4294967295] 00000400:00000200:0.0:1767323681.483861:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323681.483867:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323681.483872:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012abd00. 00000800:00000200:0.0:1767323681.483878:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323681.483886:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323681.483890:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012abd00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323681.483902:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323681.483907:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 14171 usecs (15 jiffies) 00000100:00000001:0.0:1767323681.483910:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300898323 00000100:00000001:0.0:1767323681.483919:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300899566 00000100:00000001:0.0:1767323681.483922:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300898323 00000100:00000001:0.0:1767323681.483924:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300899566 00000100:00000001:0.0:1767323681.483926:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300898323 00000100:00000001:0.0:1767323681.483927:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300899566 00000100:00000001:0.0:1767323681.483929:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300898323 00000100:00000001:0.0:1767323681.483931:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300899566 00000100:00000001:0.0:1767323681.483934:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323681.483936:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.483939:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.483941:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.483945:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323681.483946:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:0.0:1767323681.483948:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323681.483949:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323681.483951:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323681.483953:0:111004:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000001:0.0:1767323681.483955:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.483957:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323681.483958:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.483960:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323681.483961:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323681.483962:0:111004:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:0.0:1767323681.483968:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.483975:0:111004:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1767323681.483976:0:111004:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323681.483978:0:111004:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:0.0:1767323681.483980:0:111004:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:0.0:1767323681.483982:0:111004:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1767323681.483984:0:111004:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9410118eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975849216:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323681.483996:0:111004:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:0.0:1767323681.483999:0:111004:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:0.0:1767323681.484000:0:111004:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323681.484002:0:111004:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:0.0:1767323681.484004:0:111004:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff941010c03200. 02000000:00000001:0.0:1767323681.484006:0:111004:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:0.0:1767323681.484009:0:111004:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941010716898. 00000400:00000010:0.0:1767323681.484013:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941008997ee0. 00000100:00000200:0.0:1767323681.484016:0:111004:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975849216, portal 10 00000100:00000001:0.0:1767323681.484018:0:111004:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:0.0:1767323681.484019:0:111004:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395467790848 : -118678241760768 : ffff9410118eaa00) 00000100:00000040:0.0:1767323681.484024:0:111004:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.484030:0:111004:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1767323681.484032:0:111004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:0.0:1767323681.484035:0:111004:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff9410089977f8. 00000100:00000200:0.0:1767323681.484037:0:111004:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975849216, offset 0 00000400:00000200:0.0:1767323681.484041:0:111004:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:0.0:1767323681.484045:0:111004:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:0.0:1767323681.484048:0:111004:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:0.0:1767323681.484050:0:111004:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:0.0:1767323681.484053:0:111004:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:0.0:1767323681.484056:0:111004:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:0.0:1767323681.484059:0:111004:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1555:1555:255:4294967295] 192.168.204.130@tcp LPNI seq info [1555:1555:7:4294967295] 00000400:00000200:0.0:1767323681.484066:0:111004:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:0.0:1767323681.484070:0:111004:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:0.0:1767323681.484074:0:111004:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410012ab400. 00000800:00000200:0.0:1767323681.484078:0:111004:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:0.0:1767323681.484082:0:111004:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:0.0:1767323681.484084:0:111004:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410012ab400 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:0.0:1767323681.484087:0:111004:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323681.484095:0:111004:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 13061 usecs (14 jiffies) 00000100:00000001:0.0:1767323681.484098:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300898322 00000100:00000001:0.0:1767323681.484100:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300899566 00000100:00000001:0.0:1767323681.484102:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300898322 00000100:00000001:0.0:1767323681.484104:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300899566 00000100:00000001:0.0:1767323681.484106:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300898322 00000100:00000001:0.0:1767323681.484108:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300899566 00000100:00000001:0.0:1767323681.484110:0:111004:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300898322 00000100:00000001:0.0:1767323681.484112:0:111004:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300899566 00000100:00000001:0.0:1767323681.484114:0:111004:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323681.484116:0:111004:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.484118:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.484120:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323681.484405:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323681.484408:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323681.484966:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323681.484987:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012abd00. 00000400:00000200:1.0:1767323681.484994:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323681.485000:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323681.485005:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997330 00000400:00000010:1.0:1767323681.485007:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997330. 00000100:00000001:1.0:1767323681.485010:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323681.485016:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323681.485026:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323681.485029:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323681.485035:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323681.485037:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000200:1.0:1767323681.485107:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323681.485110:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410012ab400. 00000400:00000200:1.0:1767323681.485113:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323681.485117:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323681.485119:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff9410089977f8 00000400:00000010:1.0:1767323681.485120:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff9410089977f8. 00000100:00000001:1.0:1767323681.485122:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323681.485125:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323681.485130:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323681.485131:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323681.485135:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323681.485136:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000800:00000001:3.0:1767323681.498037:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323681.498056:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323681.498061:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323681.498063:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323681.498075:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323681.498092:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540580 00000400:00000200:3.0:1767323681.498114:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3291 [1] + 224 00000800:00000001:3.0:1767323681.498122:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323681.498129:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323681.498132:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323681.498137:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323681.498144:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323681.498154:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323681.498165:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.498188:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323681.498196:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323681.498200:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:3.0:1767323681.498202:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323681.498204:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323681.498208:0:110995:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:3.0:1767323681.498214:0:110995:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540500 00000400:00000200:3.0:1767323681.498219:0:110995:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x3299 [1] + 224 00000800:00000001:3.0:1767323681.498223:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323681.498229:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:3.0:1767323681.498231:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323681.498248:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:3.0:1767323681.498252:0:110995:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:3.0:1767323681.498257:0:110995:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1767323681.498266:0:110995:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323681.498272:0:110995:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:3.0:1767323681.498277:0:110995:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:3.0:1767323681.498280:0:110995:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.498555:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323681.498561:0:111004:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1767323681.498568:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323681.498571:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323681.498574:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716898. 00000400:00000200:0.0:1767323681.498580:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997ee0 00000400:00000010:0.0:1767323681.498583:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997ee0. 00000100:00000001:0.0:1767323681.498586:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323681.498591:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323681.498601:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.498607:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323681.498609:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.498612:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323681.498615:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323681.498617:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323681.498619:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323681.498630:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323681.498652:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=133 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323681.498658:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=133 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323681.498660:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323681.498662:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323681.498665:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:0.0:1767323681.498669:0:111004:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.498674:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323681.498676:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323681.498678:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323681.498680:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323681.498686:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.498693:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323681.498696:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323681.498698:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323681.498703:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323681.498711:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975849216:192.168.204.130@tcp:400:kworker.0 00000400:00000001:0.0:1767323681.498717:0:111004:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1767323681.498719:0:111004:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323681.498721:0:111004:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941010716cb8. 00000400:00000200:0.0:1767323681.498724:0:111004:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941008997cc0 00000400:00000010:0.0:1767323681.498726:0:111004:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941008997cc0. 00000100:00000001:0.0:1767323681.498728:0:111004:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323681.498731:0:111004:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323681.498739:0:111004:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.498745:0:111004:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323681.498747:0:111004:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.498753:0:111004:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323681.498755:0:111004:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323681.498756:0:111004:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323681.498758:0:111004:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323681.498760:0:111004:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323681.498765:0:111004:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=133 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323681.498769:0:111004:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=133 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323681.498771:0:111004:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323681.498772:0:111004:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323681.498774:0:111004:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1767323681.498779:0:111004:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1767323681.498786:0:111004:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.498788:0:111004:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323681.498790:0:111004:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323681.498791:0:111004:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323681.498793:0:111004:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323681.498796:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.498803:0:111004:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323681.498804:0:111004:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323681.498806:0:111004:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323681.498809:0:111004:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323681.498816:0:111004:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9410118e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111004:1853171975849344:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323681.498820:0:111004:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.498823:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323681.498826:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118eaa00 x1853171975849216/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.498832:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323681.498842:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323681.498853:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010c03200. 02000000:00000001:0.0:1767323681.498858:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323681.498860:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323681.498862:0:111004:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323681.498865:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323681.498867:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3900. 02000000:00000001:0.0:1767323681.498872:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323681.498874:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323681.498876:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118eaa00. 00000100:00000001:0.0:1767323681.498881:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323681.498883:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.498885:0:111004:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323681.498889:0:111004:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9410118e8380 x1853171975849344/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323697 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323681.498895:0:111004:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323681.498896:0:111004:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323681.498898:0:111004:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff941010c03e00. 02000000:00000001:0.0:1767323681.498900:0:111004:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323681.498901:0:111004:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323681.498902:0:111004:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323681.498904:0:111004:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323681.498905:0:111004:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff941006cb3a00. 02000000:00000001:0.0:1767323681.498908:0:111004:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323681.498909:0:111004:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323681.498910:0:111004:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff9410118e8380. 00000100:00000001:0.0:1767323681.498913:0:111004:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323681.498914:0:111004:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.498917:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323681.498924:0:111004:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323681.498926:0:111004:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323681.498929:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323681.498931:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323682.055546:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323682.055552:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323682.055558:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323682.055560:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323682.055679:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323682.055682:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323682.055685:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1767323682.759529:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300899566, at 4300899584 00000100:00000040:2.0:1767323682.759529:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300899566, at 4300899584 00000100:00000040:1.0:1767323682.759534:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300899566, at 4300899584 00000100:00000010:1.0:1767323682.759545:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5c00. 00000100:00000010:3.0:1767323682.759546:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5ea0. 00000100:00000040:0.0:1767323682.759678:0:114754:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300899566, at 4300899584 00000100:00000010:0.0:1767323682.759701:0:114754:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5000. 00000100:00000010:2.0:1767323682.760550:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941010de5660. 00010000:00000001:0.0:1767323683.080443:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323683.080449:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323683.080455:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323683.080456:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323683.080851:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323683.080858:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323683.080864:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323684.106141:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323684.106148:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323684.106154:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323684.106155:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323684.106264:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323684.106267:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323684.106270:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323685.127578:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323685.127589:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323685.127596:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323685.127597:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1767323685.127707:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1767323685.127712:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1767323685.127715:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000001:0.0:1767323686.152213:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323686.152220:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323686.152225:0:114754:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323686.152226:0:114754:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1767323686.152906:0:130264:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:2.0:1767323686.152922:0:130264:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:2.0:1767323686.152925:0:130264:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1767323686.600346:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) a00b263e-ee70-4193-8137-db92c096fca5->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323686.600358:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323686.600380:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5880. 00000020:00000040:0.0:1767323686.600486:0:96413:0:(genops.c:1229:class_import_get()) import ffff941005ebf000 refcount=4 obd=MGC192.168.204.130@tcp 00000100:00000001:0.0:1767323686.600491:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323686.600494:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323686.600500:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323686.600509:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012abd00. 00000100:00000001:0.0:1767323686.600675:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.600689:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging a00b263e-ee70-4193-8137-db92c096fca5->MGS req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323686.600701:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323686.600705:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.600711:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003879b242] to pc [ptlrpcd_00_00+0] req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.600754:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323686.600759:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323686.600761:0:111001:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323686.600768:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.600775:0:111001:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323686.600777:0:111001:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323686.600781:0:111001:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323686.600784:0:111001:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323686.600786:0:111001:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323686.600790:0:111001:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975849472:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323686.600794:0:111001:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323686.600800:0:111001:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323686.600802:0:111001:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323686.600804:0:111001:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323686.600808:0:111001:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fc00. 02000000:00000001:2.0:1767323686.600810:0:111001:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323686.600817:0:111001:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35688. 00000400:00000010:2.0:1767323686.600823:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc37f8. 00000100:00000200:2.0:1767323686.600830:0:111001:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975849472, portal 25 00000100:00000001:2.0:1767323686.600832:0:111001:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323686.600834:0:111001:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470915712 : -118678238635904 : ffff941011be5880) 00000100:00000040:2.0:1767323686.600839:0:111001:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.600847:0:111001:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323686.600849:0:111001:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323686.600852:0:111001:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3990. 00000100:00000200:2.0:1767323686.600855:0:111001:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1853171975849472, offset 0 00000400:00000200:2.0:1767323686.600862:0:111001:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323686.600876:0:111001:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323686.600882:0:111001:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323686.600902:0:111001:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323686.600906:0:111001:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323686.600909:0:111001:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323686.600913:0:111001:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1556:1556:256:4294967295] 192.168.204.130@tcp LPNI seq info [1556:1556:8:4294967295] 00000400:00000200:2.0:1767323686.600924:0:111001:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323686.600931:0:111001:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323686.600937:0:111001:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7700. 00000800:00000200:2.0:1767323686.600943:0:111001:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323686.600951:0:111001:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323686.600956:0:111001:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7700 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323686.601009:0:111001:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.601013:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 0 is 4300904686 00000100:00000010:2.0:1767323686.601018:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49360. 00000100:00000001:2.0:1767323686.601024:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 0 00000100:00000001:2.0:1767323686.601030:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 1 is 4300904686 00000100:00000010:2.0:1767323686.601032:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49660. 00000100:00000001:2.0:1767323686.601035:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 1 00000100:00000001:2.0:1767323686.601038:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 2 is 4300904686 00000100:00000010:2.0:1767323686.601041:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a49480. 00000100:00000001:2.0:1767323686.601043:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 2 00000100:00000001:2.0:1767323686.601046:0:111001:0:(niobuf.c:662:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS new deadline estimation for cpu 3 is 4300904686 00000100:00000010:2.0:1767323686.601048:0:111001:0:(niobuf.c:665:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at ffff941007a491e0. 00000100:00000001:2.0:1767323686.601051:0:111001:0:(niobuf.c:677:kick_cpu_latency()) MGC192.168.204.130@tcp: PM QoS request now active for cpu 3 00000100:00000001:2.0:1767323686.601054:0:111001:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323686.601056:0:111001:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.601059:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.601061:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1767323686.601100:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323686.601104:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000200:1.0:1767323686.601178:0:110994:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323686.601182:0:110994:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7700. 00000400:00000200:1.0:1767323686.601188:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323686.601198:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323686.601213:0:110994:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3990 00000400:00000010:1.0:1767323686.601215:0:110994:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3990. 00000100:00000001:1.0:1767323686.601220:0:110994:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323686.601224:0:110994:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.601234:0:110994:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323686.601238:0:110994:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.601244:0:110994:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323686.601245:0:110994:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:0.0:1767323686.601275:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.601279:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323686.601288:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323686.601291:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be6d80. 00000020:00000040:0.0:1767323686.601295:0:96413:0:(genops.c:1229:class_import_get()) import ffff94102024e000 refcount=4 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323686.601297:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323686.601299:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323686.601301:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323686.601305:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab900. 00000100:00000001:0.0:1767323686.601309:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.601314:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0000_UUID req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323686.601321:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323686.601324:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.601328:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008fd8fbd1] to pc [ptlrpcd_00_01+1] req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323686.601361:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323686.601371:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323686.601373:0:111002:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1767323686.601378:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323686.601552:0:111002:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1767323686.601553:0:111002:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323686.601555:0:111002:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1767323686.601557:0:111002:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1767323686.601559:0:111002:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1767323686.601563:0:111002:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975849600:192.168.204.130@tcp:400:kworker.0 00000100:00000001:3.0:1767323686.601566:0:111002:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1767323686.601569:0:111002:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1767323686.601577:0:111002:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1767323686.601580:0:111002:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1767323686.601583:0:111002:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff9410087b4e00. 02000000:00000001:3.0:1767323686.601585:0:111002:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1767323686.601589:0:111002:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941001328ec8. 00000400:00000010:3.0:1767323686.601594:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec2a8. 00000100:00000200:3.0:1767323686.601598:0:111002:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975849600, portal 10 00000100:00000001:3.0:1767323686.601600:0:111002:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1767323686.601601:0:111002:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470921088 : -118678238630528 : ffff941011be6d80) 00000100:00000040:3.0:1767323686.601609:0:111002:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323686.601615:0:111002:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1767323686.601618:0:111002:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:3.0:1767323686.601620:0:111002:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941005aec3b8. 00000100:00000200:3.0:1767323686.601623:0:111002:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975849600, offset 0 00000400:00000200:3.0:1767323686.601628:0:111002:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:3.0:1767323686.601635:0:111002:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:3.0:1767323686.601639:0:111002:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:3.0:1767323686.601642:0:111002:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:3.0:1767323686.601644:0:111002:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:3.0:1767323686.601646:0:111002:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:3.0:1767323686.601649:0:111002:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1557:1557:256:4294967295] 192.168.204.130@tcp LPNI seq info [1557:1557:8:4294967295] 00000400:00000200:3.0:1767323686.601656:0:111002:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:3.0:1767323686.601660:0:111002:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:3.0:1767323686.601664:0:111002:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff941006cb3f00. 00000800:00000200:3.0:1767323686.601668:0:111002:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:3.0:1767323686.601673:0:111002:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:3.0:1767323686.601675:0:111002:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff941006cb3f00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:3.0:1767323686.601687:0:111002:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1767323686.601691:0:111002:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: using a timeout of 13363 usecs (14 jiffies) 00000100:00000001:3.0:1767323686.601694:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300903440 00000100:00000001:3.0:1767323686.601702:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300904686 00000100:00000001:3.0:1767323686.601704:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300903440 00000100:00000001:3.0:1767323686.601706:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300904686 00000100:00000001:3.0:1767323686.601708:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300903440 00000100:00000001:3.0:1767323686.601711:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300904686 00000100:00000001:3.0:1767323686.601712:0:111002:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300903440 00000100:00000001:3.0:1767323686.601714:0:111002:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0000-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300904686 00000100:00000001:3.0:1767323686.601716:0:111002:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1767323686.601719:0:111002:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323686.601722:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323686.601724:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000800:00000200:1.0:1767323686.601916:0:110996:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:1.0:1767323686.601920:0:110996:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff941006cb3f00. 00000400:00000200:1.0:1767323686.601925:0:110996:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323686.601930:0:110996:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:1.0:1767323686.601934:0:110996:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec3b8 00000400:00000010:1.0:1767323686.601936:0:110996:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec3b8. 00000100:00000001:1.0:1767323686.601939:0:110996:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:1.0:1767323686.601943:0:110996:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.601951:0:110996:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323686.601954:0:110996:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.601961:0:110996:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323686.601962:0:110996:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:2.0:1767323686.602469:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323686.602472:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323686.602475:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323686.602484:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323686.602487:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.602489:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323686.602701:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1767323686.602704:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1767323686.602707:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1767323686.602708:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1767323686.602710:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323686.602712:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.602770:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323686.602772:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323686.602774:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.602776:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323686.602810:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.602814:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:0.0:1767323686.602817:0:96413:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:0.0:1767323686.602823:0:96413:0:(client.c:592:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at ffff941011be5c00. 00000020:00000040:0.0:1767323686.602827:0:96413:0:(genops.c:1229:class_import_get()) import ffff941020249000 refcount=4 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000100:00000001:0.0:1767323686.602831:0:96413:0:(client.c:844:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:0.0:1767323686.602834:0:96413:0:(sec.c:440:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:0.0:1767323686.602837:0:96413:0:(sec.c:464:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:0.0:1767323686.602843:0:96413:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at ffff9410012ab300. 00000100:00000001:0.0:1767323686.602848:0:96413:0:(client.c:924:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.602854:0:96413:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-MDT0001_UUID req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:0.0:1767323686.602864:0:96413:0:(jobid.c:940:lustre_get_jobid()) Process entered 00000100:00000001:0.0:1767323686.602868:0:96413:0:(jobid.c:980:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.602872:0:96413:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007608b19c] to pc [ptlrpcd_00_02+2] req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.602926:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323686.602929:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323686.602930:0:111003:0:(client.c:1797:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1767323686.602938:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.602945:0:111003:0:(client.c:1363:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1767323686.602946:0:111003:0:(client.c:1421:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323686.602949:0:111003:0:(sec.c:715:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1767323686.602952:0:111003:0:(sec.c:746:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1767323686.602954:0:111003:0:(sec.c:774:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1767323686.602956:0:111003:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff941011be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975849728:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323686.602960:0:111003:0:(niobuf.c:865:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1767323686.602963:0:111003:0:(sec.c:1068:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1767323686.602965:0:111003:0:(sec.c:1105:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323686.602967:0:111003:0:(sec.c:1852:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1767323686.602971:0:111003:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at ffff94100743fa00. 02000000:00000001:2.0:1767323686.602973:0:111003:0:(sec.c:1862:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1767323686.602978:0:111003:0:(lib-me.c:70:LNetMEAttach()) slab-alloced 'me': 88 at ffff941009a35738. 00000400:00000010:2.0:1767323686.602983:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3660. 00000100:00000200:2.0:1767323686.602987:0:111003:0:(niobuf.c:1096:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1853171975849728, portal 10 00000100:00000001:2.0:1767323686.602989:0:111003:0:(client.c:3244:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1767323686.602990:0:111003:0:(client.c:3246:ptlrpc_request_addref()) Process leaving (rc=18446625395470916608 : -118678238635008 : ffff941011be5c00) 00000100:00000040:2.0:1767323686.602996:0:111003:0:(niobuf.c:1116:ptl_send_rpc()) @@@ send flags=200 req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.603001:0:111003:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1767323686.603003:0:111003:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.130@tcp 00000400:00000010:2.0:1767323686.603006:0:111003:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at ffff941039bc3e58. 00000100:00000200:2.0:1767323686.603008:0:111003:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1853171975849728, offset 0 00000400:00000200:2.0:1767323686.603018:0:111003:0:(lib-move.c:5303:LNetPut()) LNetPut -> 12345-192.168.204.130@tcp 00000400:00000200:2.0:1767323686.603028:0:111003:0:(lib-move.c:2973:lnet_handle_send_case_locked()) Source ANY to MR: 192.168.204.130@tcp local destination 00000400:00000200:2.0:1767323686.603032:0:111003:0:(lib-move.c:2603:lnet_find_best_ni_on_local_net()) selected best_lpn tcp 00000400:00000200:2.0:1767323686.603035:0:111003:0:(lib-move.c:1789:lnet_get_best_ni()) selected best_ni 192.168.204.30@tcp 00000400:00000200:2.0:1767323686.603038:0:111003:0:(lib-move.c:1343:lnet_select_peer_ni()) 192.168.204.30@tcp lpni_is_preferred = 0 00000400:00000200:2.0:1767323686.603040:0:111003:0:(lib-move.c:1412:lnet_select_peer_ni()) sd_best_lpni = 192.168.204.130@tcp 00000400:00000200:2.0:1767323686.603043:0:111003:0:(lib-move.c:1909:lnet_handle_send()) 192.168.204.30@tcp NI seq info: [1558:1558:256:4294967295] 192.168.204.130@tcp LPNI seq info [1558:1558:8:4294967295] 00000400:00000200:2.0:1767323686.603052:0:111003:0:(lib-move.c:2024:lnet_handle_send()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp:) -> 192.168.204.130@tcp(192.168.204.130@tcp:192.168.204.130@tcp) : PUT try# 0 00000800:00000200:2.0:1767323686.603056:0:111003:0:(socklnd_cb.c:1001:ksocknal_send()) sending 224 bytes in 1 frags to 12345-192.168.204.130@tcp 00000800:00000010:2.0:1767323686.603060:0:111003:0:(socklnd_cb.c:41:ksocknal_alloc_tx()) alloc '(tx)': 248 at ffff9410083d7a00. 00000800:00000200:2.0:1767323686.603065:0:111003:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [ffff9410097c2240] -> 12345-192.168.204.130@tcp (5) 00000800:00000200:2.0:1767323686.603070:0:111003:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.204.130@tcp ip 192.168.204.130:988 00000800:00000200:2.0:1767323686.603073:0:111003:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff9410083d7a00 type 1, nob 320 niov 1 nkiov 1 00000100:00000001:2.0:1767323686.603089:0:111003:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323686.603093:0:111003:0:(niobuf.c:634:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: using a timeout of 14491 usecs (15 jiffies) 00000100:00000001:2.0:1767323686.603096:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 0 is 4300903442 00000100:00000001:2.0:1767323686.603100:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 0, keep current deadline 4300904686 00000100:00000001:2.0:1767323686.603102:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 1 is 4300903442 00000100:00000001:2.0:1767323686.603104:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 1, keep current deadline 4300904686 00000100:00000001:2.0:1767323686.603106:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 2 is 4300903442 00000100:00000001:2.0:1767323686.603108:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 2, keep current deadline 4300904686 00000100:00000001:2.0:1767323686.603109:0:111003:0:(niobuf.c:662:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS new deadline estimation for cpu 3 is 4300903442 00000100:00000001:2.0:1767323686.603111:0:111003:0:(niobuf.c:691:kick_cpu_latency()) lustre-MDT0001-mdc-ffff9410201aa800: PM QoS request active for cpu 3, keep current deadline 4300904686 00000100:00000001:2.0:1767323686.603113:0:111003:0:(niobuf.c:1134:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323686.603116:0:111003:0:(client.c:1925:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.603118:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.603119:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000800:00000200:3.0:1767323686.603215:0:110995:0:(socklnd_cb.c:539:ksocknal_process_transmit()) send(0) 0 00000800:00000010:3.0:1767323686.603219:0:110995:0:(socklnd_cb.c:98:ksocknal_free_tx()) kfreed 'tx': 248 at ffff9410083d7a00. 00000400:00000200:3.0:1767323686.603224:0:110995:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1767323686.603229:0:110995:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000400:00000200:3.0:1767323686.603233:0:110995:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3e58 00000400:00000010:3.0:1767323686.603236:0:110995:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3e58. 00000100:00000001:3.0:1767323686.603239:0:110995:0:(events.c:34:request_out_callback()) Process entered 00000100:00000200:3.0:1767323686.603243:0:110995:0:(events.c:39:request_out_callback()) @@@ type 5, status 0 req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323686.603251:0:110995:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1767323686.603254:0:110995:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1767323686.603260:0:110995:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1767323686.603262:0:110995:0:(events.c:68:request_out_callback()) Process leaving 00000100:00000001:1.0:1767323686.603451:0:111004:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323686.603454:0:111004:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323686.603503:0:96413:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.603506:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323686.603510:0:96413:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323686.603512:0:96413:0:(pinger.c:229:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1767323686.603515:0:96413:0:(pinger.c:247:ptlrpc_pinger_process_import()) 266cb04f-2455-4d17-9fb2-b78bc8e504ec->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00000040:0.0:1767323686.606908:0:96413:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (6241) 00000100:00000001:2.0:1767323686.607206:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323686.607224:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1767323686.607228:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323686.607231:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1767323686.607538:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323686.607542:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:1.0:1767323686.609913:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.609941:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323686.609945:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.609948:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323686.609960:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323686.609979:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 25 MB=0x6957339540600 00000400:00000200:1.0:1767323686.610003:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index 19 from 12345-192.168.204.130@tcp of length 224/224 into md 0x32a1 [1] + 224 00000800:00000001:1.0:1767323686.610012:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.610017:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323686.610019:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323686.610023:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323686.610031:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323686.610041:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323686.610052:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.610078:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323686.610088:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.610092:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323686.610094:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.610096:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323686.610100:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323686.610106:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540700 00000400:00000200:1.0:1767323686.610112:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x32b1 [1] + 224 00000800:00000001:1.0:1767323686.610115:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.610118:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323686.610120:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323686.610122:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323686.610125:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323686.610129:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1767323686.610137:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.610147:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000800:00000001:1.0:1767323686.610150:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.610152:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000800:00000001:1.0:1767323686.610159:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.610161:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323686.610165:0:110994:0:(lib-move.c:4793:lnet_parse()) TRACE: 192.168.204.30@tcp(192.168.204.30@tcp) <- 192.168.204.130@tcp : PUT - for me 00000400:00000200:1.0:1767323686.610170:0:110994:0:(lib-ptl.c:584:lnet_ptl_match_md()) Request from 12345-192.168.204.130@tcp of length 224 into portal 10 MB=0x6957339540680 00000400:00000200:1.0:1767323686.610174:0:110994:0:(lib-ptl.c:210:lnet_try_match_md()) Incoming put index a from 12345-192.168.204.130@tcp of length 224/224 into md 0x32a9 [1] + 224 00000800:00000001:1.0:1767323686.610177:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.610183:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000400:00000200:1.0:1767323686.610184:0:110994:0:(lib-msg.c:1046:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1767323686.610187:0:110994:0:(lib-msg.c:823:lnet_health_check()) health check: 192.168.204.30@tcp->192.168.204.130@tcp: PUT: OK 00000100:00000001:1.0:1767323686.610190:0:110994:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323686.610194:0:110994:0:(events.c:80:reply_in_callback()) @@@ type 2, status 0 req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323686.610414:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323686.610420:0:111003:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1767323686.610427:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000001:0.0:1767323686.610428:0:111003:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000100:00000001:2.0:1767323686.610431:0:111001:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1767323686.610432:0:111003:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1767323686.610437:0:111003:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35738. 00000100:00000040:1.0:1767323686.611972:0:110994:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.611996:0:110994:0:(events.c:163:reply_in_callback()) Process leaving 00000400:00000200:0.0:1767323686.612042:0:111003:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc3660 00000400:00000010:0.0:1767323686.612047:0:111003:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc3660. 00000400:00000001:2.0:1767323686.612597:0:111001:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1767323686.612601:0:111001:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1767323686.612604:0:111001:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941009a35688. 00000400:00000200:2.0:1767323686.612609:0:111001:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941039bc37f8 00000400:00000010:2.0:1767323686.612612:0:111001:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941039bc37f8. 00000100:00000001:2.0:1767323686.612615:0:111001:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:2.0:1767323686.612623:0:111001:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1767323686.612633:0:111001:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.612639:0:111001:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:2.0:1767323686.612642:0:111001:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323686.612645:0:111001:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:2.0:1767323686.612649:0:111001:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1767323686.612651:0:111001:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1767323686.612653:0:111001:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1767323686.612656:0:111001:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1767323686.612663:0:111001:0:(import.c:2128:obd_at_measure()) add 5 to ffff941005ebf458 time=139 v=5 (5 0 0 0) 00000100:00001000:2.0:1767323686.612667:0:111001:0:(import.c:2128:obd_at_measure()) add 1 to ffff941005ebf410 time=139 v=5 (1 0 0 0) 00000100:00000001:2.0:1767323686.612669:0:111001:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1767323686.612671:0:111001:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1767323686.612674:0:111001:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:2.0:1767323686.612676:0:111001:0:(ldlm_request.c:1520:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.612678:0:111001:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1767323686.612683:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.612689:0:111001:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1767323686.612693:0:111001:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1767323686.612694:0:111001:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1767323686.612698:0:111001:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1767323686.612714:0:111001:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a00b263e-ee70-4193-8137-db92c096fca5:111001:1853171975849472:192.168.204.130@tcp:400:kworker.0 00000100:00000001:2.0:1767323686.612720:0:111001:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323686.612724:0:111001:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1767323686.612727:0:111001:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5880 x1853171975849472/t0(0) o400->MGC192.168.204.130@tcp@192.168.204.130@tcp:26/25 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1767323686.612733:0:111001:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1767323686.612735:0:111001:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1767323686.612738:0:111001:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fc00. 02000000:00000001:2.0:1767323686.612819:0:111001:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1767323686.612822:0:111001:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:2.0:1767323686.612824:0:111001:0:(genops.c:1242:class_import_put()) import ffff941005ebf000 refcount=3 obd=MGC192.168.204.130@tcp 00000020:00000001:2.0:1767323686.612827:0:111001:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:2.0:1767323686.612830:0:111001:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012abd00. 02000000:00000001:2.0:1767323686.612834:0:111001:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1767323686.612836:0:111001:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1767323686.612838:0:111001:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5880. 00000100:00000001:2.0:1767323686.612842:0:111001:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1767323686.612843:0:111001:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323686.612845:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1767323686.612853:0:111001:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1767323686.612854:0:111001:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1767323686.612857:0:111001:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1767323686.612859:0:111001:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000800:00000001:1.0:1767323686.613358:0:110994:0:(socklnd_cb.c:345:ksocknal_receive()) Process entered 00000800:00000001:1.0:1767323686.613377:0:110994:0:(socklnd_cb.c:383:ksocknal_receive()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323686.613414:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323686.613418:0:111002:0:(client.c:1974:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1767323686.613422:0:111002:0:(lib-msg.c:21:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1767323686.613424:0:111002:0:(lib-msg.c:30:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1767323686.613427:0:111002:0:(lib-me.c:113:lnet_me_unlink()) slab-freed 'me': 88 at ffff941001328ec8. 00000400:00000200:1.0:1767323686.613432:0:111002:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md ffff941005aec2a8 00000400:00000010:1.0:1767323686.613434:0:111002:0:(lib-lnet.h:312:lnet_md_free()) slab-freed 'md': 136 at ffff941005aec2a8. 00000100:00000001:1.0:1767323686.613437:0:111002:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:1.0:1767323686.613443:0:111002:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1767323686.613453:0:111002:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.613460:0:111002:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:1.0:1767323686.613462:0:111002:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323686.613465:0:111002:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:1.0:1767323686.613472:0:111002:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1767323686.613473:0:111002:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1767323686.613475:0:111002:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1767323686.613478:0:111002:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1767323686.613484:0:111002:0:(import.c:2128:obd_at_measure()) add 5 to ffff94102024e458 time=138 v=5 (5 0 0 0) 00000100:00001000:1.0:1767323686.613488:0:111002:0:(import.c:2128:obd_at_measure()) add 1 to ffff94102024e410 time=138 v=5 (1 0 0 0) 00000100:00000001:1.0:1767323686.613490:0:111002:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1767323686.613492:0:111002:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1767323686.613495:0:111002:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1767323686.613498:0:111002:0:(ldlm_request.c:1546:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323686.613501:0:111002:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:1.0:1767323686.613503:0:111002:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:1.0:1767323686.613505:0:111002:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:1.0:1767323686.613506:0:111002:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323686.613511:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.613527:0:111002:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1767323686.613530:0:111002:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1767323686.613532:0:111002:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1767323686.613546:0:111002:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1767323686.613554:0:111002:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111002:1853171975849600:192.168.204.130@tcp:400:kworker.0 00000100:00000001:1.0:1767323686.613559:0:111002:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323686.613561:0:111002:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1767323686.613565:0:111002:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be6d80 x1853171975849600/t0(0) o400->lustre-MDT0000-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1767323686.613573:0:111002:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1767323686.613575:0:111002:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1767323686.613577:0:111002:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff9410087b4e00. 02000000:00000001:1.0:1767323686.613581:0:111002:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1767323686.613583:0:111002:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:1.0:1767323686.613585:0:111002:0:(genops.c:1242:class_import_put()) import ffff94102024e000 refcount=3 obd=lustre-MDT0000-mdc-ffff9410201aa800 00000020:00000001:1.0:1767323686.613587:0:111002:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:1.0:1767323686.613597:0:111002:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab900. 02000000:00000001:1.0:1767323686.613608:0:111002:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1767323686.613610:0:111002:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1767323686.613612:0:111002:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be6d80. 00000100:00000001:1.0:1767323686.613616:0:111002:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1767323686.613617:0:111002:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323686.613619:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1767323686.613624:0:111002:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1767323686.613626:0:111002:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1767323686.613629:0:111002:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1767323686.613632:0:111002:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323686.614104:0:111003:0:(events.c:78:reply_in_callback()) Process entered 00000100:00000200:0.0:1767323686.614111:0:111003:0:(events.c:80:reply_in_callback()) @@@ type 6, status 0 req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1767323686.614119:0:111003:0:(events.c:102:reply_in_callback()) @@@ unlink req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323686.614124:0:111003:0:(events.c:163:reply_in_callback()) Process leaving 00000100:00000001:0.0:1767323686.614125:0:111003:0:(client.c:2957:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323686.614127:0:111003:0:(client.c:1578:after_reply()) Process entered 02000000:00000001:0.0:1767323686.614129:0:111003:0:(sec.c:1113:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1767323686.614131:0:111003:0:(pack_generic.c:602:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1767323686.614132:0:111003:0:(pack_generic.c:620:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1767323686.614135:0:111003:0:(sec.c:1169:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1767323686.614139:0:111003:0:(import.c:2128:obd_at_measure()) add 5 to ffff941020249458 time=138 v=5 (5 0 0 0) 00000100:00001000:0.0:1767323686.614142:0:111003:0:(import.c:2128:obd_at_measure()) add 1 to ffff941020249410 time=138 v=5 (1 0 0 0) 00000100:00000001:0.0:1767323686.614144:0:111003:0:(client.c:1480:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1767323686.614152:0:111003:0:(client.c:1518:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323686.614154:0:111003:0:(ldlm_request.c:1516:ldlm_cli_update_pool()) Process entered 00010000:00080000:0.0:1767323686.614158:0:111003:0:(ldlm_request.c:1534:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1767323686.614165:0:111003:0:(ldlm_request.c:1535:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323686.614167:0:111003:0:(client.c:3065:ptlrpc_free_committed()) Process entered 00000100:00000040:0.0:1767323686.614169:0:111003:0:(client.c:3077:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff9410201aa800: skip recheck: last_committed 0 00000100:00000001:0.0:1767323686.614171:0:111003:0:(client.c:3078:ptlrpc_free_committed()) Process leaving 00000100:00000001:0.0:1767323686.614172:0:111003:0:(client.c:1781:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1767323686.614175:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323686.614182:0:111003:0:(client.c:2329:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:0.0:1767323686.614184:0:111003:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1767323686.614186:0:111003:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1767323686.614189:0:111003:0:(lustre_net.h:2431:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1767323686.614299:0:111003:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff941011be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:266cb04f-2455-4d17-9fb2-b78bc8e504ec:111003:1853171975849728:192.168.204.130@tcp:400:kworker.0 00000100:00000001:0.0:1767323686.614306:0:111003:0:(client.c:2440:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323686.614308:0:111003:0:(client.c:2842:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1767323686.614312:0:111003:0:(client.c:2850:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff941011be5c00 x1853171975849728/t0(0) o400->lustre-MDT0001-mdc-ffff9410201aa800@192.168.204.130@tcp:12/10 lens 224/224 e 0 to 0 dl 1767323702 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1767323686.614318:0:111003:0:(client.c:2768:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1767323686.614320:0:111003:0:(sec.c:1877:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1767323686.614322:0:111003:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at ffff94100743fa00. 02000000:00000001:0.0:1767323686.614324:0:111003:0:(sec.c:1891:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1767323686.614326:0:111003:0:(genops.c:1236:class_import_put()) Process entered 00000020:00000040:0.0:1767323686.614327:0:111003:0:(genops.c:1242:class_import_put()) import ffff941020249000 refcount=3 obd=lustre-MDT0001-mdc-ffff9410201aa800 00000020:00000001:0.0:1767323686.614328:0:111003:0:(genops.c:1249:class_import_put()) Process leaving 02000000:00000010:0.0:1767323686.614330:0:111003:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at ffff9410012ab300. 02000000:00000001:0.0:1767323686.614332:0:111003:0:(sec.c:480:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1767323686.614333:0:111003:0:(sec.c:497:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1767323686.614339:0:111003:0:(client.c:598:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at ffff941011be5c00. 00000100:00000001:0.0:1767323686.614341:0:111003:0:(client.c:2824:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1767323686.614342:0:111003:0:(client.c:2883:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323686.614344:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1767323686.614348:0:111003:0:(client.c:2614:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1767323686.614349:0:111003:0:(client.c:2642:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1767323686.614351:0:111003:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1767323686.614352:0:111003:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000080:00000001:0.0:1767323686.661750:0:131583:0:(llite_lib.c:4131:ll_show_options()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:3.0:1767323686.890113:0:131619:0:(debug.c:664:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:3.0:1767323686.890119:0:131619:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-lfsck test_18e: @@@@@@ FAIL: (3) MDS1 is not the expected 'scanning-phase2' 00000001:00000001:3.0:1767323686.896205:0:131619:0:(debug.c:667:libcfs_debug_mark_buffer()) ************************************************** 00010000:00000001:0.0:1767323687.176489:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323687.176496:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1767323687.176502:0:127095:0:(ldlm_pool.c:458:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:0.0:1767323687.176504:0:127095:0:(ldlm_pool.c:462:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1767323687.178664:0:130265:0:(genops.c:1912:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1767323687.178669:0:130265:0:(genops.c:1926:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1767323687.178672:0:130265:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00000001:1.0:1767323687.772697:0:131719:0:(llite_lib.c:4131:ll_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1767323687.879510:0:130407:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb110 (cpu 0) has reached its deadline 4300904686, at 4300904704 00000100:00000010:1.0:1767323687.879527:0:130407:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49660. 00000100:00000040:2.0:1767323687.879666:0:126942:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb220 (cpu 0) has reached its deadline 4300904686, at 4300904704 00000100:00000010:2.0:1767323687.879671:0:126942:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49480. 00000100:00000040:0.0:1767323687.880669:0:127095:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb000 (cpu 0) has reached its deadline 4300904686, at 4300904705 00000100:00000010:0.0:1767323687.880682:0:127095:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a49360. 00000100:00000040:3.0:1767323687.881162:0:60555:0:(connection.c:75:cpu_latency_work()) work item of ffff941002dbb330 (cpu 0) has reached its deadline 4300904686, at 4300904705 00000100:00000010:3.0:1767323687.881169:0:60555:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at ffff941007a491e0. Debug log: 20113 lines, 20113 kept, 0 dropped, 0 bad.